Summary: RG and NomCom support refinements, new data merge management commands, bug fixes
Release Date: Tue, February 18, 2020 at 10:59 PM UTC
Release Author: Henrik Levkowetz

• Merged in [17288] from rjsparks@nostrum.com:
  Made internal review email about an RG use the IRSG instead of the
  IESG in text and addresses. Fixes #2881.

• Merged in [17287] from rjsparks@nostrum.com:
  Set the default for use_milestone_dates to True. Allow changing
  use_milestone_dates from the edit milestone dates form for charters if it
  is the initial chartering effort. Fixes #2884.

• Wrapped more code in draft submission in an exception block, in order not
  to continue processing after an XML parse exception. Fixes issue #2885.

• Fixed a bug in the resource description for SchedulingEvent that prevented
  it from being accessed under /api/v1/meeting/schedulingevent/.

• Added search fields to the admin index for SchedulingEvent.

• Tweaked send_mail_mime() to recognize settings.SERVER_MODE='repair', in
  order to avoid mail floods when running the mergedata management
  command. It is assumed that the appropriate mails went out when the data
  was entered into the system the first time.

• Added a management command to dump data based on table names and primary
  keys derived from a list of SQL INSERT INTO commands representing the
  items to be dumped. The output formats are the same as for dumpdata, and
  are suitable for later use with the loaddata or mergedata management
  commands.

• Added a management command to merge data from one of two divergent django
  databases to the other, taking care to insert or update records as
  appropriate, and update foreign keys and many-to-many keys appropriately.
  Accepts the dump formats generated by the dumpdata command.

• Updated the check_referential_integrity command, adding a --delete command
  to remove dangling references to removed records, and also adding
  colorized success/fail indications for each FK and m2m key inspected.

• Changed the xml parser settings for legacy xml draft submissions to remove
  comments before converting to .txt. Fixes and issue with comments in
  text.

• jsonfield 3.0 and higher is not compatible with Django 1.11. Changed the
  version requirements accordingly.

• Added missing test directory creation and removal in setUp() and
  tearDown() in MeetingTests.

• Merged in [17286] from rjsparks@nostrum.com:
  Added Reply-To to the default group review text. Fixes #2883.

• Merged in [17284] from jennifer@painless-security.com:
  Create DocEvent when related IprDisclosure is posted or removed. Fixes
  #2811.

• Merged in [17275] from jennifer@painless-security.com:
  Added links to user profiles from nominee list and feedback page. Fixes
  #2839.

• Merged in [17273] from rcross@amsl.com:
  Updated link to session request tool instructions.

Coverage

Release Date: Wed, February 5, 2020 at 10:28 PM UTC
Release Author: Henrik Levkowetz

Python 2/3 transition fixes, sumbmission and chartering improvements

• Merged in [17268] from rjsparks@nostrum.com: Set a meaningful state in a
  test fixture. Tests surprisingly were not broken by this though.

• Merged in [17266] from rjsparks@nostrum.com: Improve the tests for session
  draft bundles to exercise the code that extracts draftnames from agendas.

• Removed exec of activate_this.py from 2 more scripts that are in
  activbe use.

• Ran scripts invoked from bin/hourly and bin/daily through pyflakes3 and
  trial invocation, and tweaked the code (with an added comment) to
  consistently require virtualenv to be set up before script invocation.

• Added some raw_id fields to avoid long page load times for admin pages.

• Fixed a py2/py3 issue in sync.rfceditor.post_approved_draft(), and
  enhanced tests to execute the failing code (with Mock functions) instead
  of skipping the code.

• Hardcoded an rsync target path, and added a bash trap for errors in hourly
  and daily cron scripts.

• Fixed some py2/py3 issues in ID index generation modules.

• Fixed a py2/py3 issue in building meeting materials bundles.

• Added a setting for a coming yang-catalog submission checker url.

• Did some re-ordering of PLAN items after a priority discussion.

• Fixed a py2/py3 issue in post_approved_draft()

• Changed the location of the file cache for htmlized documents so it will
  be handled by backup rsync of the /a/ file system.

• Added a newline to test run command output, to separate dot progress
  indication from teardown messages.

• Added a test case for draft submission errors due to periods in document
  names.

• Added a suggestion to the error message issued for invalid characters in
  document names found in draft submission XML files, when the invalid
  character is a period. In this particular case, the problem most likely
  is inclusion of the filename extension in the document name. Fixes issue
  #2874.

• Changed draft submission field validation taking place in clean() to
  associate the errors with the field in question, rather than raising them
  as general form errors.

• Fixed a Py3 issue trying run .decode() on (already decoded) string
  instances.

• Merged in [17246] from rjsparks@nostrum.com: Only show groups in
  reasonable states when showing current chartering efforts (otherwise
  crufty charter states can would lead to abandoned or replaced groups
  showing here). Fixes #2872.

Coverage

Release Date: Fri, January 17, 2020 at 6:20 PM UTC
Release Author: Henrik Levkowetz

• Refined the links from document stats pages to author pages so as to
  not link to non-existent pages. Fixes 404 errors for a number of stats
  page links.

• Merged in [17234] from rjsparks@nostrum.com:
  Restrict the ability to change whether a group uses milestone dates to
  the ADs and the secretariat. Fixes #2869.

• Merged in [17233] from rjsparks@nostrum.com:
  Be clear about who changed a group's personnel in the resulting email
  message. Fixes #2868.

• Merged in [17228] from rjsparks@nostrum.com:
  Improved admin handling of DocumentURL. Fixes #2865.

• Merged in [17227] from rjsparks@nostrum.com:
  Allow document Additional URLs to become empty. Fixes #2864.

• Added (currently inactive) code to trigger exceptions on failure to
  resolve template variables during tests, and added fixes for a couple of
  places that triggered such exceptions.

• Merged in [17219] from rjsparks@nostrum.com:
  Update some uses of pos.ad in templates to pos.balloter. Fixes #2863.

• Merged in [17217] from olau@iola.dk:
  Tighten validation of session conflicts in the session request tool,
  preventing conflicts where source = target. Make sure the 'use
  previous session' button doesn't carry forward conflicts that are no
  longer valid.
  Also fix a bug with the group list in the dropdowns being computed
  statically at module import time instead of being queried dynamically
  upon each page request.

• Merged in [17211] from rjsparks@nostrum.com:
  Upgrade to the newer js-cookie library that replaced jquery.cookie.
  Fixes #2832.

• Fixed a Py2/3 compatibility issue with the verified errata code.

• Merged in [17201] from rjsparks@nostrum.com:
  Make it easier for the nomcom chair to manage generic IESG
  requirements. Fixes #2794.

• Added a check for uncomitted changes to bin/mergedevbranch.

• Added fetch and use of the RFC-Editor's errata.json file in order to set a
  new verified-errata document tag, and use that to show the link to
  inline-errata documents only when there is verified errata.
  Fixes issue #2861.

Coverage

Summary: Dateless group milestones, improved author stats, and bugfixes
Release Date: Thu, January 9, 2020 at 9:58 PM UTC
Release Author: Henrik Levkowetz

• Merged in [17196] from rcross@amsl.com:
  Removed agenda@ietf.org from audio import notification To: list.

• Merged in [17195] from rcross@amsl.com:
  Updated admin permissions to grant secretariat access to
  LiaisonStatementGroupContacts.

• Merged in [17185] from rjsparks@nostrum.com:
  Added support for dateless milestones. Fixes issue #2799.

• Specified explicit UTF-8 decoding of submission checker output, in
  order to avoid issues when reporting errors due to UTF-8 content.

• Merged in [17181] from olau@iola.dk:
  Fixed a problem with assignments to the same session causing a crash.

• Merged in [17179] from housley@vigilsec.com:
  Added references and referened-by buttons to each RFC listed on the person
  profile page. In addition, changed the buttons on the document references
  and document referenced-by pages to match the buttons on the main document
  page (the buttons with the long arrows). Fixes #2854, although it does not
  include the number of references in the button.

• Merged in [17178] from housley@vigilsec.com:
  Turned text names into links on the stats pages. Fixes issue #2854.

• Refactored some document methods to align better with Django's
  get_absolute_url(), and added Person.get_absolute_uri()

• Merged in [17177] from rjsparks@nostrum.com:
  Improve can_ballot. Fixes #2856.

• Limited the permitted versions of mypy and related django-slugs, to avoid
  issues related to using Django-1.11. We should update to latest versions
  when we've moved to Django 2.2.x

• Changed ReviewerSettings history change-reason field to be a TextField, in
  order to accomodate longer change descriptions.

• Merged in [17173] from rjsparks@nostrum.com:
  Worked around a problem with displaying IESG evaluation information for
  non-approve ballot types. Partially addresses #2851.

Coverage

Summary: IRSG document ballot support
Release Date: Fri, December 20, 2019 at 3:44 PM UTC
Release Author: Henrik Levkowetz

• Merged in ^/branch/akayla/irsg/6.113.1.dev0 from peter@akayla.com:
  This provides support for IRSG ballots, similar to the IESG ballots
  support which has been in use for quite some time. The IRSG ballots differ
  from IESG ballots in a number of ways, described in detail in the RFP and
  SoW for this work and implemented here.

• Changed print() statements into syslog logging in a cron-invoked script,
  to remove non-error output. Fixes issue #2849.

Coverage

Summary: Refactoring and renaming of some meetings models and fields
Release Date: Wed, December 18, 2019 at 8:38 PM UTC
Release Author: Henrik Levkowetz

• Merged in [17148] from rjsparks@nostrum.com:
  Only gather addresses instead of name_addrs for the group_secretaries
  Mailtrigger Recipient. Fixes #2847.

• Merged in [17147] from rjsparks@nostrum.com:
  Show diff controls for a bis -00 document. Fixes #2846.

• Merged /branch/iola/meeting-improvement-r16992@17152 from olau@iola.dk:

  • Renamed Meeting.agenda to Meeting.schedule together with a bunch of
    related internal things,

  • Moved Session.status, .requested, and .requested_by to a new
    SchedulingEvent.

  • Turned sessions into regular sessions and non-sessions into misc.
    sessions in the UI and code to avoid ambiguity.
    This doesn't change the data in the DB except for uses of TimeSlotTypeName
    where session is now regular.

• Added a requirement limitation for the coverage module.

• Added handling for a decoding exception during submission processing.

• Merged in [17120] from rjsparks@nostrum.com:
  Add links to the main website and the mailarchive to the search page.

• Added an OPTIONS settings to the DATABASES setting in
  docker/settings_local.py, to make some migration operations work under
  docker.

Coverage

Summary: Review tool queue management with pluggable policies
Release Date: Sat, December 7, 2019 at 7:28 PM UTC
Release Author: Henrik Levkowetz

This release introcudes the ability for review group secretaries to choose
between different management policies for the review queue, as it turns
out that both the needs and preferences of the groups and group secretaries
vary in this regard. With this release it is possible to choose between
two policies: a Rotate Alphabetically policy, and a Least Recently Used
policy. Both policies provides for various exceptions. There are also
some unrelated minor bugfixes. From the commit log:

• Merged in work from sasha@dashcare.nl on Review Queue Managemnt:
  This abstracts queue management, making it possible to implement different
  policies for each team. It provides two concrete policies:
  RotateAlphabeticallyReviewerQueuePolicy, which rotates an alphabetically
  ordered reviewer list with consideration for skip indications, and is the
  default policy; and LeastRecentlyUsedReviewerQueuePolicy, a simple
  least-recently-used policy. Also see issue #2721, and #2656, which
  documents various flaws in the old queue code.

• Added fallback handling from utf-8 to latin1 when reading charter text
  files.

• Added normalization of draft title extracted from submitted XML.

• Removed code under docker/ from test coverage calculation.

• Fixed a backwards compatibiltiy issue for the factoryboy lib and
  updated a dependency requirement.

Coverage

Release Date: Wed, November 27, 2019 at 11:04 PM UTC
Release Author: Henrik Levkowetz

Review tool tickets roundup, part 6; and other fixes

This provides more review tool fixes, and clears the slate for an upcoming
branch merge. From the commit log:

• Merged in [17085] from sasha@dashcare.nl:
  Notify secretary when a review request is closed. The assigned reviewer
  was already notified, but secretaries were always excluded.
  Fixes issue #2278

• When group secretary email addresses occurred in some mailtrigger To:
  entries, they were given with both name and address parts, while when
  occurring in Cc: entries, no name parts were present. Fixed one case of
  this related to current review tool changes, and adjusted a test case for
  consistency. Also added a general utility function to exclude selected
  email addresses from email address lists.

• Added support for bibxml3 entries using the traditional reference entry
  name (using reference.I-D....), instead of just the plain draft name.

• Merged in [17070] from sasha@dashcare.nl:
  Improved complete review workflow for secretaries. When a secretary
  completes a review, link to a review message is automatically selected,
  and the first non-reply mail is used to fill in the review details. The
  secretary can still modify all details. The order of fields for
  secretaries is also modified to fit this workflow. All cases where 'link
  to review message' is used, by reviewers or secretaries, now attempt to
  fill in the reviewed version if found in the email subject.
  Fixes issue #2061.

• Merged in [17069] from sasha@dashcare.nl:
  Added history for assignments, requests and unavailability.
  Fixes issues #2074 and #2358.

• Added a test for bibtex page content-type.

• Fixed an incorrect content_type.

• Merged in [17097] from rjsparks@nostrum.com:
  Removed unreachable assertion from slide reordering utility function.

• Merged in [17090] from rjsparks@nostrum.com:
  Added pages to assignment email. Fixes #2838.

• Merged in [17083] from kivinen@iki.fi:
  Moved hard coded defaults for max items to show and days to show to the
  settings.py.

• Merged in [17071] from rjsparks@nostrum.com:
  Use doc.name explicitly now that name is no lonker the pk. Pointed out
  by Sasha in #2050.

Coverage

Summary: IETF 106 code sprint
Release Date: Thu, November 21, 2019 at 6:50 AM UTC
Release Author: Henrik Levkowetz

This release contains datatracker bug fixes and enhancements from the
IETF-106 Code Sprint. This sprint brought in new contributors, and saw
substantial work from previous contributors. Thanks to everyone who
contributed!

• Merged in [17062] from rjsparks@nostrum.com:
  Change the default template for assigned review emails to name the
  assigned reviewer. Fixes #2830.

• Merged in [17061] and [17024] from rjsparks@nostrum.com:
  Allow slides drag-drop between sessions for groups meeting with
  multiple sessions. Fixes #2700.

• Merged in [17044] from valery@smyslov.net:
  Make it clearer that a chair can't revise materials for a meeting once
  the proceedings deadline has passed. Fixes issue #2612.

• Merged in [17037] from kivinen@iki.fi:
  Added padding to the column in the unavailability period list of
  the reviewers page.

• Merged in [17036] from housley@vigilsec.com:
  Drop old slides section from agenda.json

• Merged in [17035] from housley@vigilsec.com:
  Improved performance for some agenda-related pages

• Merged in [17034] from kivinen@iki.fi:
  Added two new configuration settings for the review team secretary,
  one to set how many days to include in the reviewers list, and
  another one to limit the number of completed items in the list for
  each person. This version replaces the one I did earlier, and includes
  much more test cases to test different limits on the reviewers page.

• Added an instance of force_text() to ensure non_ascii mail subjects are
  unicode when used for string interpolation, rather than bytes (which will
  trigger ascii decode()).

• Merged in [17033] from kivinen@iki.fi:
  Reviewers page template changes. Changed draft names so they never wrap.
  Changed the Unavailability period table so it is much narrower.

• Merged in [17031] from fenton@bluepopcorn.net:
  Add edit button for Secreatriat on concluded groups. Fixes #2781.

• RFCs with inline errata now have a non-beta URL. Updated the setting.

• Merged in [17028] from fenton@bluepopcorn.net:
  Added a Closing note field to state specific WG edit. Fixes #2779.

• Merged in [17027] from rcross@amsl.com:
  Fix issue where draft resurrect feature does not move most recent draft
  file from the archive directory back to the current draft directory. Fixes
  #2646.

• Tweaked docker-init.sh to create a needed GID entry before using it
  when creating a new user. Fixes an issue when the user GID in the
  host OS is missing in the docker image.

• Added fullcalendar to the bower.json file.

• Changed the call arguments for submission tool conversion from XML to
  v3 text to match those of the standalone tool. Fixes an issue where
  would have line ends stripped when converted by the datatracker.

• Tweaked a test's person name form to match the usage in the tested code.

• Fixed naming of staged xml draft submission files and tweaked the
  arguments for the xml2rfc parser invocation for xml draft submissions.
  Added some more logging.

Coverage

Release Date: Mon, November 11, 2019 at 9:35 PM UTC
Release Author: Henrik Levkowetz

This release provides various fixes, and clears the slate for the
upcoming IETF 106 Sprint work.

• Merged in [16981] from rjsparks@nostrum.com:
  Look at the tree of replaces-relationships when determining if some
  reviewer has reviewed this (or perhaps an ancestor) of this document.
  Fixes #2821.

• Merged in [16966] from rjsparks@nostrum.com:
  Use the recently released shepherd writeup templates. Fixes #2820.

• Fixed a wrong link to field help for liaison forms.

• Merged in [16939] from sasha@dashcare.nl:
  Allow adding review wishes from document and search pages. On the main
  page of a document and in document search results, a new button allows
  review team members to add a review wish for that document.
  For reviewers that are only on one team, this essentially works
  identical to tracking a document. Reviewers that are on multiple teams
  are lead through an intermediate step to select a review team, and then
  returned to their search or document page.
  Fixes issue #2050.

• Merged in [16564] from pusateri@bangj.com and added tests:
  Convert markdown to html if Accept header prioritizes text/html over
  text/markdown. Fixes #1926.

• Merged in [16977] from rjsparks@nostrum.com:
  Disregard unassigned reviews when building the sets to compare when
  checking for race-conditions on assigning reviews.
  Partially addresses #2821.

• Moved the ietf/names/generate_fixtures.py command to a management command
  "generate_name_fixture", and updated it to include a necessary dbtemplate
  object in the fixture.

Coverage