+++++++++++

Python News

+++++++++++

What's New in Python 3.6.0 alpha 1?

===================================

Release date: tba

Core and Builtins

-----------------

- Issue #26136: Upgrade the warning when a generator raises StopIteration

from PendingDeprecationWarning to DeprecationWarning. Patch by Anish

Shah.

- Issue #26204: The compiler now ignores all constant statements: bytes, str,

int, float, complex, name constants (None, False, True), Ellipsis

and ast.Constant; not only str and int. For example, ``1.0`` is now ignored

in ``def f(): 1.0``.

- Issue #4806: Avoid masking the original TypeError exception when using star

(*) unpacking in function calls. Based on patch by Hagen Fürstenau and

Daniel Urban.

- Issue #26146: Add a new kind of AST node: ``ast.Constant``. It can be used

by external AST optimizers, but the compiler does not emit directly such

node.

- Issue #23601: Sped-up allocation of dict key objects by using Python's

small object allocator. (Contributed by Julian Taylor.)

- Issue #18018: Import raises ImportError instead of SystemError if a relative

import is attempted without a known parent package.

- Issue #25843: When compiling code, don't merge constants if they are equal

but have a different types. For example, ``f1, f2 = lambda: 1, lambda: 1.0``

is now correctly compiled to two different functions: ``f1()`` returns ``1``

(``int``) and ``f2()`` returns ``1.0`` (``int``), even if ``1`` and ``1.0``

are equal.

- Issue #26107: The format of the ``co_lnotab`` attribute of code objects

changes to support negative line number delta.

- Issue #26154: Add a new private _PyThreadState_UncheckedGet() function to get

the current Python thread state, but don't issue a fatal error if it is NULL.

This new function must be used instead of accessing directly the

_PyThreadState_Current variable. The variable is no more exposed since

Python 3.5.1 to hide the exact implementation of atomic C types, to avoid

compiler issues.

- Issue #25791: If __package__ != __spec__.parent or if neither __package__ or

__spec__ are defined then ImportWarning is raised.

- Issue #25731: Fix set and deleting __new__ on a class.

- Issue #25961: Disallowed null characters in the type name.

- Issue #25973: Fix segfault when an invalid nonlocal statement binds a name

starting with two underscores.

- Issue #22995: Instances of extension types with a state that aren't

subclasses of list or dict and haven't implemented any pickle-related

methods (__reduce__, __reduce_ex__, __getnewargs__, __getnewargs_ex__,

or __getstate__), can no longer be pickled. Including memoryview.

- Issue #20440: Massive replacing unsafe attribute setting code with special

macro Py_SETREF.

- Issue #25766: Special method __bytes__() now works in str subclasses.

- Issue #25421: __sizeof__ methods of builtin types now use dynamic basic size.

This allows sys.getsize() to work correctly with their subclasses with

__slots__ defined.

- Issue #25709: Fixed problem with in-place string concatenation and utf-8 cache.

- Issue #5319: New Py_FinalizeEx() API allowing Python to set an exit status

of 120 on failure to flush buffered streams.

- Issue #25485: telnetlib.Telnet is now a context manager.

- Issue #24097: Fixed crash in object.__reduce__() if slot name is freed inside

__getattr__.

- Issue #24731: Fixed crash on converting objects with special methods

__bytes__, __trunc__, and __float__ returning instances of subclasses of

bytes, int, and float to subclasses of bytes, int, and float correspondingly.

- Issue #25630: Fix a possible segfault during argument parsing in functions

that accept filesystem paths.

- Issue #23564: Fixed a partially broken sanity check in the _posixsubprocess

internals regarding how fds_to_pass were passed to the child. The bug had

no actual impact as subprocess.py already avoided it.

- Issue #25388: Fixed tokenizer crash when processing undecodable source code

with a null byte.

- Issue #25462: The hash of the key now is calculated only once in most

operations in C implementation of OrderedDict.

- Issue #22995: Default implementation of __reduce__ and __reduce_ex__ now

rejects builtin types with not defined __new__.

- Issue #24802: Avoid buffer overreads when int(), float(), compile(), exec()

and eval() are passed bytes-like objects. These objects are not

necessarily terminated by a null byte, but the functions assumed they were.

- Issue #25555: Fix parser and AST: fill lineno and col_offset of "arg" node

when compiling AST from Python objects.

- Issue #24726: Fixed a crash and leaking NULL in repr() of OrderedDict that

was mutated by direct calls of dict methods.

- Issue #25449: Iterating OrderedDict with keys with unstable hash now raises

KeyError in C implementations as well as in Python implementation.

- Issue #25395: Fixed crash when highly nested OrderedDict structures were

garbage collected.

- Issue #25401: Optimize bytes.fromhex() and bytearray.fromhex(): they are now

between 2x and 3.5x faster.

- Issue #25399: Optimize bytearray % args using the new private _PyBytesWriter

API. Formatting is now between 2.5 and 5 times faster.

- Issue #25274: sys.setrecursionlimit() now raises a RecursionError if the new

recursion limit is too low depending at the current recursion depth. Modify

also the "lower-water mark" formula to make it monotonic. This mark is used

to decide when the overflowed flag of the thread state is reset.

- Issue #24402: Fix input() to prompt to the redirected stdout when

sys.stdout.fileno() fails.

- Issue #25349: Optimize bytes % args using the new private _PyBytesWriter API.

Formatting is now up to 2 times faster.

- Issue #24806: Prevent builtin types that are not allowed to be subclassed from

being subclassed through multiple inheritance.

- Issue #25301: The UTF-8 decoder is now up to 15 times as fast for error

handlers: ``ignore``, ``replace`` and ``surrogateescape``.

- Issue #24848: Fixed a number of bugs in UTF-7 decoding of misformed data.

- Issue #25267: The UTF-8 encoder is now up to 75 times as fast for error

handlers: ``ignore``, ``replace``, ``surrogateescape``, ``surrogatepass``.

Patch co-written with Serhiy Storchaka.

- Issue #25280: Import trace messages emitted in verbose (-v) mode are no

longer formatted twice.

- Issue #25227: Optimize ASCII and latin1 encoders with the ``surrogateescape``

error handler: the encoders are now up to 3 times as fast. Initial patch

written by Serhiy Storchaka.

- Issue #25003: On Solaris 11.3 or newer, os.urandom() now uses the

getrandom() function instead of the getentropy() function. The getentropy()

function is blocking to generate very good quality entropy, os.urandom()

doesn't need such high-quality entropy.

- Issue #9232: Modify Python's grammar to allow trailing commas in the

argument list of a function declaration. For example, "def f(\*, a =

3,): pass" is now legal. Patch from Mark Dickinson.

- Issue #24965: Implement PEP 498 "Literal String Interpolation". This

allows you to embed expressions inside f-strings, which are

converted to normal strings at run time. Given x=3, then

f'value={x}' == 'value=3'. Patch by Eric V. Smith.

- Issue #26171: Fix possible integer overflow and heap corruption in

zipimporter.get_data().

- Issue #25660: Fix TAB key behaviour in REPL with readline.

- Issue #26288: Optimize PyLong_AsDouble.

- Issues #26289 and #26315: Optimize floor and modulo division for

single-digit longs. Microbenchmarks show 2-2.5x improvement. Built-in

'divmod' function is now also ~10% faster.

- Issue #25887: Raise a RuntimeError when a coroutine object is awaited

more than once.

Library

-------

Issue #26186: Remove an invalid type check in importlib.util.LazyLoader.

- Issue #26367: importlib.__init__() raises ImportError like

builtins.__import__() when ``level`` is specified but without an accompanying

package specified.

- Issue #26309: In the "socketserver" module, shut down the request (closing

the connected socket) when verify_request() returns false. Patch by Aviv

Palivoda.

- Issue #25939: On Windows open the cert store readonly in ssl.enum_certificates.

- Issue #25995: os.walk() no longer uses FDs proportional to the tree depth.

- Issue #25994: Added the close() method and the support of the context manager

protocol for the os.scandir() iterator.

- Issue #23992: multiprocessing: make MapResult not fail-fast upon exception.

- Issue #26243: Support keyword arguments to zlib.compress(). Patch by Aviv

Palivoda.

- Issue #26117: The os.scandir() iterator now closes file descriptor not only

when the iteration is finished, but when it was failed with error.

- Issue #25949: __dict__ for an OrderedDict instance is now created only when

needed.

- Issue #25911: Restored support of bytes paths in os.walk() on Windows.

- Issue #26045: Add UTF-8 suggestion to error message when posting a

non-Latin-1 string with http.client.

- Issue #26039: Added zipfile.ZipInfo.from_file() and zipinfo.ZipInfo.is_dir().

Patch by Thomas Kluyver.

- Issue #12923: Reset FancyURLopener's redirect counter even if there is an

exception. Based on patches by Brian Brazil and Daniel Rocco.

- Issue #25945: Fixed a crash when unpickle the functools.partial object with

wrong state. Fixed a leak in failed functools.partial constructor.

"args" and "keywords" attributes of functools.partial have now always types

tuple and dict correspondingly.

- Issue #26202: copy.deepcopy() now correctly copies range() objects with

non-atomic attributes.

- Issue #23076: Path.glob() now raises a ValueError if it's called with an

invalid pattern. Patch by Thomas Nyberg.

- Issue #19883: Fixed possible integer overflows in zipimport.

- Issue #26227: On Windows, getnameinfo(), gethostbyaddr() and

gethostbyname_ex() functions of the socket module now decode the hostname

from the ANSI code page rather than UTF-8.

- Issue #26099: The site module now writes an error into stderr if

sitecustomize module can be imported but executing the module raise an

ImportError. Same change for usercustomize.

- Issue #26147: xmlrpc now works with strings not encodable with used

non-UTF-8 encoding.

- Issue #25935: Garbage collector now breaks reference loops with OrderedDict.

- Issue #16620: Fixed AttributeError in msilib.Directory.glob().

- Issue #26013: Added compatibility with broken protocol 2 pickles created

in old Python 3 versions (3.4.3 and lower).

- Issue #26129: Deprecated accepting non-integers in grp.getgrgid().

- Issue #25850: Use cross-compilation by default for 64-bit Windows.

- Issue #25822: Add docstrings to the fields of urllib.parse results.

Patch contributed by Swati Jaiswal.

- Issue #22642: Convert trace module option parsing mechanism to argparse.

Patch contributed by SilentGhost.

- Issue #24705: Fix sysconfig._parse_makefile not expanding ${} vars

appearing before $() vars.

- Issue #26069: Remove the deprecated apis in the trace module.

- Issue #22138: Fix mock.patch behavior when patching descriptors. Restore

original values after patching. Patch contributed by Sean McCully.

- Issue #25672: In the ssl module, enable the SSL_MODE_RELEASE_BUFFERS mode

option if it is safe to do so.

- Issue #22570: Add 'path' attribute to pathlib.Path objects,

returning the same as str(), to make it more similar to DirEntry.

Library code can now write getattr(p, 'path', p) to get the path as

a string from a Path, a DirEntry, or a plain string. This is

essentially a small one-off protocol.

- Issue #26012: Don't traverse into symlinks for ** pattern in

pathlib.Path.[r]glob().

- Issue #24120: Ignore PermissionError when traversing a tree with

pathlib.Path.[r]glob(). Patch by Ulrich Petri.

- Issue #21815: Accept ] characters in the data portion of imap responses,

in order to handle the flags with square brackets accepted and produced

by servers such as gmail.

- Issue #25447: fileinput now uses sys.stdin as-is if it does not have a

buffer attribute (restores backward compatibility).

- Issue #25971: Optimized creating Fractions from floats by 2 times and from

Decimals by 3 times.

- Issue #25802: Document as deprecated the remaining implementations of

importlib.abc.Loader.load_module().

- Issue #25928: Add Decimal.as_integer_ratio().

- Issue #25447: Copying the lru_cache() wrapper object now always works,

independently from the type of the wrapped object (by returning the original

object unchanged).

- Issue #25768: Have the functions in compileall return booleans instead of

ints and add proper documentation and tests for the return values.

- Issue #24103: Fixed possible use after free in ElementTree.XMLPullParser.

- Issue #25860: os.fwalk() no longer skips remaining directories when error

occurs. Original patch by Samson Lee.

- Issue #25914: Fixed and simplified OrderedDict.__sizeof__.

- Issue #25869: Optimized deepcopying ElementTree; it is now 20 times faster.

- Issue #25873: Optimized iterating ElementTree. Iterating elements

Element.iter() is now 40% faster, iterating text Element.itertext()

is now up to 2.5 times faster.

- Issue #25902: Fixed various refcount issues in ElementTree iteration.

- Issue #22227: The TarFile iterator is reimplemented using generator.

This implementation is simpler that using class.

- Issue #25638: Optimized ElementTree.iterparse(); it is now 2x faster.

Optimized ElementTree parsing; it is now 10% faster.

- Issue #25761: Improved detecting errors in broken pickle data.

- Issue #25717: Restore the previous behaviour of tolerating most fstat()

errors when opening files. This was a regression in 3.5a1, and stopped

anonymous temporary files from working in special cases.

- Issue #24903: Fix regression in number of arguments compileall accepts when

'-d' is specified. The check on the number of arguments has been dropped

completely as it never worked correctly anyway.

- Issue #25764: In the subprocess module, preserve any exception caused by

fork() failure when preexec_fn is used.

- Issue #25771: Tweak the exception message for importlib.util.resolve_name()

when 'package' isn't specified but necessary.

- Issue #6478: _strptime's regexp cache now is reset after changing timezone

with time.tzset().

- Issue #14285: When executing a package with the "python -m package" option,

and package initialization fails, a proper traceback is now reported. The

"runpy" module now lets exceptions from package initialization pass back to

the caller, rather than raising ImportError.

- Issue #19771: Also in runpy and the "-m" option, omit the irrelevant

message ". . . is a package and cannot be directly executed" if the package

could not even be initialized (e.g. due to a bad ``*.pyc`` file).

- Issue #25177: Fixed problem with the mean of very small and very large

numbers. As a side effect, statistics.mean and statistics.variance should

be significantly faster.

- Issue #25718: Fixed copying object with state with boolean value is false.

- Issue #10131: Fixed deep copying of minidom documents. Based on patch

by Marian Ganisin.

- Issue #7990: dir() on ElementTree.Element now lists properties: "tag",

"text", "tail" and "attrib". Original patch by Santoso Wijaya.

- Issue #25725: Fixed a reference leak in pickle.loads() when unpickling

invalid data including tuple instructions.

- Issue #25663: In the Readline completer, avoid listing duplicate global

names, and search the global namespace before searching builtins.

- Issue #25688: Fixed file leak in ElementTree.iterparse() raising an error.

- Issue #23914: Fixed SystemError raised by unpickler on broken pickle data.

- Issue #25691: Fixed crash on deleting ElementTree.Element attributes.

- Issue #25624: ZipFile now always writes a ZIP_STORED header for directory

entries. Patch by Dingyuan Wang.

- Issue #25626: Change three zlib functions to accept sizes that fit in

Py_ssize_t, but internally cap those sizes to UINT_MAX. This resolves a

regression in 3.5 where GzipFile.read() failed to read chunks larger than 2

or 4 GiB. The change affects the zlib.Decompress.decompress() max_length

parameter, the zlib.decompress() bufsize parameter, and the

zlib.Decompress.flush() length parameter.

- Issue #25583: Avoid incorrect errors raised by os.makedirs(exist_ok=True)

when the OS gives priority to errors such as EACCES over EEXIST.

- Issue #25593: Change semantics of EventLoop.stop() in asyncio.

- Issue #6973: When we know a subprocess.Popen process has died, do

not allow the send_signal(), terminate(), or kill() methods to do

anything as they could potentially signal a different process.

- Issue #23883: Added missing APIs to __all__ to match the documented APIs

for the following modules: calendar, csv, enum, fileinput, ftplib, logging,

optparse, tarfile, threading and wave. Also added a

test.support.check__all__() helper. Patches by Jacek Kołodziej, Mauro

S. M. Rodrigues and Joel Taddei.

- Issue #25590: In the Readline completer, only call getattr() once per

attribute. Also complete names of attributes such as properties and slots

which are listed by dir() but not yet created on an instance.

- Issue #25498: Fix a crash when garbage-collecting ctypes objects created

by wrapping a memoryview. This was a regression made in 3.5a1. Based

on patch by Eryksun.

- Issue #25584: Added "escape" to the __all__ list in the glob module.

- Issue #25584: Fixed recursive glob() with patterns starting with '\*\*'.

- Issue #25446: Fix regression in smtplib's AUTH LOGIN support.

- Issue #18010: Fix the pydoc web server's module search function to handle

exceptions from importing packages.

- Issue #25554: Got rid of circular references in regular expression parsing.

- Issue #18973: Command-line interface of the calendar module now uses argparse

instead of optparse.

- Issue #25510: fileinput.FileInput.readline() now returns b'' instead of ''

at the end if the FileInput was opened with binary mode.

Patch by Ryosuke Ito.

- Issue #25503: Fixed inspect.getdoc() for inherited docstrings of properties.

Original patch by John Mark Vandenberg.

- Issue #25515: Always use os.urandom as a source of randomness in uuid.uuid4.

- Issue #21827: Fixed textwrap.dedent() for the case when largest common

whitespace is a substring of smallest leading whitespace.

Based on patch by Robert Li.

- Issue #25447: The lru_cache() wrapper objects now can be copied and pickled

(by returning the original object unchanged).

- Issue #25390: typing: Don't crash on Union[str, Pattern].

- Issue #25441: asyncio: Raise error from drain() when socket is closed.

- Issue #25410: Cleaned up and fixed minor bugs in C implementation of

OrderedDict.

- Issue #25411: Improved Unicode support in SMTPHandler through better use of

the email package. Thanks to user simon04 for the patch.

- Move the imp module from a PendingDeprecationWarning to DeprecationWarning.

- Issue #25407: Remove mentions of the formatter module being removed in

Python 3.6.

- Issue #25406: Fixed a bug in C implementation of OrderedDict.move_to_end()

that caused segmentation fault or hang in iterating after moving several

items to the start of ordered dict.

- Issue #25382: pickletools.dis() now outputs implicit memo index for the

MEMOIZE opcode.

- Issue #25357: Add an optional newline paramer to binascii.b2a_base64().

base64.b64encode() uses it to avoid a memory copy.

- Issue #24164: Objects that need calling ``__new__`` with keyword arguments,

can now be pickled using pickle protocols older than protocol version 4.

- Issue #25364: zipfile now works in threads disabled builds.

- Issue #25328: smtpd's SMTPChannel now correctly raises a ValueError if both

decode_data and enable_SMTPUTF8 are set to true.

- Issue #16099: RobotFileParser now supports Crawl-delay and Request-rate

extensions. Patch by Nikolay Bogoychev.

- Issue #25316: distutils raises OSError instead of DistutilsPlatformError

when MSVC is not installed.

- Issue #25380: Fixed protocol for the STACK_GLOBAL opcode in

pickletools.opcodes.

- Issue #23972: Updates asyncio datagram create method allowing reuseport

and reuseaddr socket options to be set prior to binding the socket.

Mirroring the existing asyncio create_server method the reuseaddr option

for datagram sockets defaults to True if the O/S is 'posix' (except if the

platform is Cygwin). Patch by Chris Laws.

- Issue #25304: Add asyncio.run_coroutine_threadsafe(). This lets you

submit a coroutine to a loop from another thread, returning a

concurrent.futures.Future. By Vincent Michel.

- Issue #25232: Fix CGIRequestHandler to split the query from the URL at the

first question mark (?) rather than the last. Patch from Xiang Zhang.

- Issue #24657: Prevent CGIRequestHandler from collapsing slashes in the

query part of the URL as if it were a path. Patch from Xiang Zhang.

- Issue #25287: Don't add crypt.METHOD_CRYPT to crypt.methods if it's not

supported. Check if it is supported, it may not be supported on OpenBSD for

example.

- Issue #23600: Default implementation of tzinfo.fromutc() was returning

wrong results in some cases.

- Issue #25203: Failed readline.set_completer_delims() no longer left the

module in inconsistent state.

- Issue #25011: rlcompleter now omits private and special attribute names unless

the prefix starts with underscores.

- Issue #25209: rlcompleter now can add a space or a colon after completed keyword.

- Issue #22241: timezone.utc name is now plain 'UTC', not 'UTC-00:00'.

- Issue #23517: fromtimestamp() and utcfromtimestamp() methods of

datetime.datetime now round microseconds to nearest with ties going to

nearest even integer (ROUND_HALF_EVEN), as round(float), instead of rounding

towards -Infinity (ROUND_FLOOR).

- Issue #23552: Timeit now warns when there is substantial (4x) variance

between best and worst times. Patch from Serhiy Storchaka.

- Issue #24633: site-packages/README -> README.txt.

- Issue #24879: help() and pydoc can now list named tuple fields in the

order they were defined rather than alphabetically. The ordering is

determined by the _fields attribute if present.

- Issue #24874: Improve speed of itertools.cycle() and make its

pickle more compact.

- Fix crash in itertools.cycle.__setstate__() when the first argument wasn't

a list.

- Issue #20059: urllib.parse raises ValueError on all invalid ports.

Patch by Martin Panter.

- Issue #24360: Improve __repr__ of argparse.Namespace() for invalid

identifiers. Patch by Matthias Bussonnier.

- Issue #23426: run_setup was broken in distutils.

Patch from Alexander Belopolsky.

- Issue #13938: 2to3 converts StringTypes to a tuple. Patch from Mark Hammond.

- Issue #2091: open() accepted a 'U' mode string containing '+', but 'U' can

only be used with 'r'. Patch from Jeff Balogh and John O'Connor.

- Issue #8585: improved tests for zipimporter2. Patch from Mark Lawrence.

- Issue #18622: unittest.mock.mock_open().reset_mock would recurse infinitely.

Patch from Nicola Palumbo and Laurent De Buyst.

- Issue #24426: Fast searching optimization in regular expressions now works

for patterns that starts with capturing groups. Fast searching optimization

now can't be disabled at compile time.

- Issue #23661: unittest.mock side_effects can now be exceptions again. This

was a regression vs Python 3.4. Patch from Ignacio Rossi

- Issue #13248: Remove deprecated inspect.getmoduleinfo function.

- Issue #25578: Fix (another) memory leak in SSLSocket.getpeercer().

- Issue #25530: Disable the vulnerable SSLv3 protocol by default when creating

ssl.SSLContext.

- Issue #25569: Fix memory leak in SSLSocket.getpeercert().

- Issue #25471: Sockets returned from accept() shouldn't appear to be

nonblocking.

- Issue #25319: When threading.Event is reinitialized, the underlying condition

should use a regular lock rather than a recursive lock.

- Skip getaddrinfo if host is already resolved.

Patch by A. Jesse Jiryu Davis.

- Add asyncio.timeout() context manager.

- Issue #26050: Add asyncio.StreamReader.readuntil() method.

Patch by Марк Коренберг.

- Issue #25924: Avoid unnecessary serialization of getaddrinfo(3) calls on

OS X versions 10.5 or higher. Original patch by A. Jesse Jiryu Davis.

IDLE

----

- Issue 15348: Stop the debugger engine (normally in a user process)

before closing the debugger window (running in the IDLE process).

This prevents the RuntimeErrors that were being caught and ignored.

- Issue #24455: Prevent IDLE from hanging when a) closing the shell while the

debugger is active (15347); b) closing the debugger with the [X] button

(15348); and c) activating the debugger when already active (24455).

The patch by Mark Roseman does this by making two changes.

1. Suspend and resume the gui.interaction method with the tcl vwait

mechanism intended for this purpose (instead of root.mainloop & .quit).

2. In gui.run, allow any existing interaction to terminate first.

- Change 'The program' to 'Your program' in an IDLE 'kill program?' message

to make it clearer that the program referred to is the currently running

user program, not IDLE itself.

- Issue #24750: Improve the appearance of the IDLE editor window status bar.

Patch by Mark Roseman.

- Issue #25313: Change the handling of new built-in text color themes to better

address the compatibility problem introduced by the addition of IDLE Dark.

Consistently use the revised idleConf.CurrentTheme everywhere in idlelib.

- Issue #24782: Extension configuration is now a tab in the IDLE Preferences

dialog rather than a separate dialog. The former tabs are now a sorted

list. Patch by Mark Roseman.

- Issue #22726: Re-activate the config dialog help button with some content

about the other buttons and the new IDLE Dark theme.

- Issue #24820: IDLE now has an 'IDLE Dark' built-in text color theme.

It is more or less IDLE Classic inverted, with a cobalt blue background.

Strings, comments, keywords, ... are still green, red, orange, ... .

To use it with IDLEs released before November 2015, hit the

'Save as New Custom Theme' button and enter a new name,

such as 'Custom Dark'. The custom theme will work with any IDLE

release, and can be modified.

- Issue #25224: README.txt is now an idlelib index for IDLE developers and

curious users. The previous user content is now in the IDLE doc chapter.

'IDLE' now means 'Integrated Development and Learning Environment'.

- Issue #24820: Users can now set breakpoint colors in

Settings -> Custom Highlighting. Original patch by Mark Roseman.

- Issue #24972: Inactive selection background now matches active selection

background, as configured by users, on all systems. Found items are now

always highlighted on Windows. Initial patch by Mark Roseman.

- Issue #24570: Idle: make calltip and completion boxes appear on Macs

affected by a tk regression. Initial patch by Mark Roseman.

- Issue #24988: Idle ScrolledList context menus (used in debugger)

now work on Mac Aqua. Patch by Mark Roseman.

- Issue #24801: Make right-click for context menu work on Mac Aqua.

Patch by Mark Roseman.

- Issue #25173: Associate tkinter messageboxes with a specific widget.

For Mac OSX, make them a 'sheet'. Patch by Mark Roseman.

- Issue #25198: Enhance the initial html viewer now used for Idle Help.

* Properly indent fixed-pitch text (patch by Mark Roseman).

* Give code snippet a very Sphinx-like light blueish-gray background.

* Re-use initial width and height set by users for shell and editor.

* When the Table of Contents (TOC) menu is used, put the section header

at the top of the screen.

- Issue #25225: Condense and rewrite Idle doc section on text colors.

- Issue #21995: Explain some differences between IDLE and console Python.

- Issue #22820: Explain need for *print* when running file from Idle editor.

- Issue #25224: Doc: augment Idle feature list and no-subprocess section.

- Issue #25219: Update doc for Idle command line options.

Some were missing and notes were not correct.

- Issue #24861: Most of idlelib is private and subject to change.

Use idleib.idle.* to start Idle. See idlelib.__init__.__doc__.

- Issue #25199: Idle: add synchronization comments for future maintainers.

- Issue #16893: Replace help.txt with help.html for Idle doc display.

The new idlelib/help.html is rstripped Doc/build/html/library/idle.html.

It looks better than help.txt and will better document Idle as released.

The tkinter html viewer that works for this file was written by Rose Roseman.

The now unused EditorWindow.HelpDialog class and helt.txt file are deprecated.

- Issue #24199: Deprecate unused idlelib.idlever with possible removal in 3.6.

- Issue #24790: Remove extraneous code (which also create 2 & 3 conflicts).

Documentation

-------------

- Issue #24952: Clarify the default size argument of stack_size() in

the "threading" and "_thread" modules. Patch from Mattip.

Tests

-----

- Issue #26325: Added test.support.check_no_resource_warning() to check that

no ResourceWarning is emitted.

- Issue #25940: Changed test_ssl to use self-signed.pythontest.net. This

avoids relying on svn.python.org, which recently changed root certificate.

- Issue #25616: Tests for OrderedDict are extracted from test_collections

into separate file test_ordered_dict.

- Issue #25449: Added tests for OrderedDict subclasses.

- Issue #25188: Add -P/--pgo to test.regrtest to suppress error output when

running the test suite for the purposes of a PGO build. Initial patch by

Alecsandru Patrascu.

- Issue #22806: Add ``python -m test --list-tests`` command to list tests.

- Issue #18174: ``python -m test --huntrleaks ...`` now also checks for leak of

file descriptors. Patch written by Richard Oudkerk.

- Issue #25260: Fix ``python -m test --coverage`` on Windows. Remove the

list of ignored directories.

- ``PCbuild\rt.bat`` now accepts an unlimited number of arguments to pass along

to regrtest.py. Previously there was a limit of 9.

Build

-----

- Issue #25348: Added ``--pgo`` and ``--pgo-job`` arguments to

``PCbuild\build.bat`` for building with Profile-Guided Optimization. The

old ``PCbuild\build_pgo.bat`` script is removed.

- Issue #25827: Add support for building with ICC to ``configure``, including

a new ``--with-icc`` flag.

- Issue #25696: Fix installation of Python on UNIX with make -j9.

- Issue #24986: It is now possible to build Python on Windows without errors

when external libraries are not available.

- Issue #24421: Compile Modules/_math.c once, before building extensions.

Previously it could fail to compile properly if the math and cmath builds

were concurrent.

- Issue #26268: Update OS X 10.5 installer to use OpenSSL 1.0.2f.

Windows

-------

- Issue #26071: bdist_wininst created binaries fail to start and find

32bit Python

- Issue #26073: Update the list of magic numbers in launcher

- Issue #26065: Excludes venv from library when generating embeddable

distro.

- Issue #25022: Removed very outdated PC/example_nt/ directory.

Tools/Demos

-----------

- Issue #26316: Fix variable name typo in Argument Clinic.

- Issue #25440: Fix output of python-config --extension-suffix.

- Issue #25154: The pyvenv script has been deprecated in favour of

`python3 -m venv`.

C API

-----

- Issue #26312: SystemError is now raised in all programming bugs with using

PyArg_ParseTupleAndKeywords(). RuntimeError did raised before in some

programming bugs.

- Issue #26198: ValueError is now raised instead of TypeError on buffer

overflow in parsing "es#" and "et#" format units. SystemError is now raised

instead of TypeError on programmical error in parsing format string.

What's New in Python 3.5.1 final?

=================================

Release date: 2015-12-06

Core and Builtins

-----------------

- Issue #25709: Fixed problem with in-place string concatenation and

utf-8 cache.

Windows

-------

- Issue #25715: Python 3.5.1 installer shows wrong upgrade path and incorrect

logic for launcher detection.

What's New in Python 3.5.1 release candidate 1?

===============================================

Release date: 2015-11-22

Core and Builtins

-----------------

- Issue #25630: Fix a possible segfault during argument parsing in functions

that accept filesystem paths.

- Issue #23564: Fixed a partially broken sanity check in the _posixsubprocess

internals regarding how fds_to_pass were passed to the child. The bug had

no actual impact as subprocess.py already avoided it.

- Issue #25388: Fixed tokenizer crash when processing undecodable source code

with a null byte.

- Issue #25462: The hash of the key now is calculated only once in most

operations in C implementation of OrderedDict.

- Issue #22995: Default implementation of __reduce__ and __reduce_ex__ now

rejects builtin types with not defined __new__.

- Issue #25555: Fix parser and AST: fill lineno and col_offset of "arg" node

when compiling AST from Python objects.

- Issue #24802: Avoid buffer overreads when int(), float(), compile(), exec()

and eval() are passed bytes-like objects. These objects are not

necessarily terminated by a null byte, but the functions assumed they were.

- Issue #24726: Fixed a crash and leaking NULL in repr() of OrderedDict that

was mutated by direct calls of dict methods.

- Issue #25449: Iterating OrderedDict with keys with unstable hash now raises

KeyError in C implementations as well as in Python implementation.

- Issue #25395: Fixed crash when highly nested OrderedDict structures were

garbage collected.

- Issue #25274: sys.setrecursionlimit() now raises a RecursionError if the new

recursion limit is too low depending at the current recursion depth. Modify

also the "lower-water mark" formula to make it monotonic. This mark is used

to decide when the overflowed flag of the thread state is reset.

- Issue #24402: Fix input() to prompt to the redirected stdout when

sys.stdout.fileno() fails.

- Issue #24806: Prevent builtin types that are not allowed to be subclassed from

being subclassed through multiple inheritance.

- Issue #24848: Fixed a number of bugs in UTF-7 decoding of misformed data.

- Issue #25280: Import trace messages emitted in verbose (-v) mode are no

longer formatted twice.

- Issue #25003: On Solaris 11.3 or newer, os.urandom() now uses the

getrandom() function instead of the getentropy() function. The getentropy()

function is blocking to generate very good quality entropy, os.urandom()

doesn't need such high-quality entropy.

- Issue #25182: The stdprinter (used as sys.stderr before the io module is

imported at startup) now uses the backslashreplace error handler.

- Issue #25131: Make the line number and column offset of set/dict literals and

comprehensions correspond to the opening brace.

- Issue #25150: Hide the private _Py_atomic_xxx symbols from the public

Python.h header to fix a compilation error with OpenMP. PyThreadState_GET()

becomes an alias to PyThreadState_Get() to avoid ABI incompatibilies.

Library

-------

- Issue #25626: Change three zlib functions to accept sizes that fit in

Py_ssize_t, but internally cap those sizes to UINT_MAX. This resolves a

regression in 3.5 where GzipFile.read() failed to read chunks larger than 2

or 4 GiB. The change affects the zlib.Decompress.decompress() max_length

parameter, the zlib.decompress() bufsize parameter, and the

zlib.Decompress.flush() length parameter.

- Issue #25583: Avoid incorrect errors raised by os.makedirs(exist_ok=True)

when the OS gives priority to errors such as EACCES over EEXIST.

- Issue #25593: Change semantics of EventLoop.stop() in asyncio.

- Issue #6973: When we know a subprocess.Popen process has died, do

not allow the send_signal(), terminate(), or kill() methods to do

anything as they could potentially signal a different process.

- Issue #25590: In the Readline completer, only call getattr() once per

attribute.

- Issue #25498: Fix a crash when garbage-collecting ctypes objects created

by wrapping a memoryview. This was a regression made in 3.5a1. Based

on patch by Eryksun.

- Issue #25584: Added "escape" to the __all__ list in the glob module.

- Issue #25584: Fixed recursive glob() with patterns starting with '\*\*'.

- Issue #25446: Fix regression in smtplib's AUTH LOGIN support.

- Issue #18010: Fix the pydoc web server's module search function to handle

exceptions from importing packages.

- Issue #25554: Got rid of circular references in regular expression parsing.

- Issue #25510: fileinput.FileInput.readline() now returns b'' instead of ''

at the end if the FileInput was opened with binary mode.

Patch by Ryosuke Ito.

- Issue #25503: Fixed inspect.getdoc() for inherited docstrings of properties.

Original patch by John Mark Vandenberg.

- Issue #25515: Always use os.urandom as a source of randomness in uuid.uuid4.

- Issue #21827: Fixed textwrap.dedent() for the case when largest common

whitespace is a substring of smallest leading whitespace.

Based on patch by Robert Li.

- Issue #25447: The lru_cache() wrapper objects now can be copied and pickled

(by returning the original object unchanged).

- Issue #25390: typing: Don't crash on Union[str, Pattern].

- Issue #25441: asyncio: Raise error from drain() when socket is closed.

- Issue #25410: Cleaned up and fixed minor bugs in C implementation of

OrderedDict.

- Issue #25411: Improved Unicode support in SMTPHandler through better use of

the email package. Thanks to user simon04 for the patch.

- Issue #25407: Remove mentions of the formatter module being removed in

Python 3.6.

- Issue #25406: Fixed a bug in C implementation of OrderedDict.move_to_end()

that caused segmentation fault or hang in iterating after moving several

items to the start of ordered dict.

- Issue #25364: zipfile now works in threads disabled builds.

- Issue #25328: smtpd's SMTPChannel now correctly raises a ValueError if both

decode_data and enable_SMTPUTF8 are set to true.

- Issue #25316: distutils raises OSError instead of DistutilsPlatformError

when MSVC is not installed.

- Issue #25380: Fixed protocol for the STACK_GLOBAL opcode in

pickletools.opcodes.

- Issue #23972: Updates asyncio datagram create method allowing reuseport

and reuseaddr socket options to be set prior to binding the socket.

Mirroring the existing asyncio create_server method the reuseaddr option

for datagram sockets defaults to True if the O/S is 'posix' (except if the

platform is Cygwin). Patch by Chris Laws.

- Issue #25304: Add asyncio.run_coroutine_threadsafe(). This lets you

submit a coroutine to a loop from another thread, returning a

concurrent.futures.Future. By Vincent Michel.

- Issue #25232: Fix CGIRequestHandler to split the query from the URL at the

first question mark (?) rather than the last. Patch from Xiang Zhang.

- Issue #24657: Prevent CGIRequestHandler from collapsing slashes in the

query part of the URL as if it were a path. Patch from Xiang Zhang.

- Issue #24483: C implementation of functools.lru_cache() now calculates key's

hash only once.

- Issue #22958: Constructor and update method of weakref.WeakValueDictionary

now accept the self and the dict keyword arguments.

- Issue #22609: Constructor of collections.UserDict now accepts the self keyword

argument.

- Issue #25111: Fixed comparison of traceback.FrameSummary.

- Issue #25262. Added support for BINBYTES8 opcode in Python implementation of

unpickler. Highest 32 bits of 64-bit size for BINUNICODE8 and BINBYTES8

opcodes no longer silently ignored on 32-bit platforms in C implementation.

- Issue #25034: Fix string.Formatter problem with auto-numbering and

nested format_specs. Patch by Anthon van der Neut.

- Issue #25233: Rewrite the guts of asyncio.Queue and

asyncio.Semaphore to be more understandable and correct.

- Issue #25203: Failed readline.set_completer_delims() no longer left the

module in inconsistent state.

- Issue #23600: Default implementation of tzinfo.fromutc() was returning

wrong results in some cases.

- Issue #23329: Allow the ssl module to be built with older versions of

LibreSSL.