Skip to content

codecs.lookup() ignores non-ASCII characters, whereas encodings.normalize_encoding() copies them #83518

@vstinner

Description

@vstinner
BPO 39337
Nosy @malemburg, @vstinner, @serhiy-storchaka, @shihai1991
PRs
  • [WIP] bpo-39337: calling encodings.normalize_encoding() in codecs.normalizestring() to keep same behavior #18845
  • [WIP]bpo-39337: Adding a _Py_normalize_unicode_encoding() in unicodeobject.c #18987
  • bpo-39337: Add a test case for normalizing of codec names #19069
  • bpo-39337: encodings.normalize_encoding() now ignores non-ASCII characters #22219
  • bpo-41842: Add a unregister function in _codecs module #22360
  • bpo-37751: Document the change in What's New in Python 3.9 #17997
  • Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
    closed_at = <Date 2020-10-14.15:46:55.467>
    created_at = <Date 2020-01-14.21:54:42.124>
    labels = ['library', '3.10']
    title = 'codecs.lookup() ignores non-ASCII characters, whereas encodings.normalize_encoding() copies them'
    updated_at = <Date 2020-10-14.15:55:50.301>
    user = 'https://github.com/vstinner'

    bugs.python.org fields:

    activity = <Date 2020-10-14.15:55:50.301>
    actor = 'shihai1991'
    assignee = 'none'
    closed = True
    closed_date = <Date 2020-10-14.15:46:55.467>
    closer = 'vstinner'
    components = ['Library (Lib)']
    creation = <Date 2020-01-14.21:54:42.124>
    creator = 'vstinner'
    dependencies = []
    files = []
    hgrepos = []
    issue_num = 39337
    keywords = ['patch']
    message_count = 11.0
    messages = ['360004', '363645', '364180', '364449', '364452', '364456', '377772', '378281', '378626', '378628', '378630']
    nosy_count = 4.0
    nosy_names = ['lemburg', 'vstinner', 'serhiy.storchaka', 'shihai1991']
    pr_nums = ['18845', '18987', '19069', '22219', '22360', '17997']
    priority = 'normal'
    resolution = 'fixed'
    stage = 'resolved'
    status = 'closed'
    superseder = None
    type = None
    url = 'https://bugs.python.org/issue39337'
    versions = ['Python 3.10']

    Metadata

    Metadata

    Assignees

    No one assigned

      Labels

      3.10only security fixesstdlibPython modules in the Lib dir

      Projects

      No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions