Release Date: Wed, June 10, 2020 at 8:58 PM UTC
Release Author: Henrik Levkowetz

Updates to meeting registration handling and group editing; and bug fixes

• The fields ticket_type and reg_type are now part of MeetingRegistration.
  Made the conditional handling of these attributes in the OpenID
  "registration" scope handler unconditional.

• Fixed an incorrect admin site search field specification that prevented
  certain serches from working in the admin site.

• Changed the settings_local.py for the docker image to use the database
  type enforced in docker/updatedb.

• Fixed an issue with multiple objects matching a registsration record
  fetched from the registration system (this has been caused by not
  correctly detecting updates to the registration system details).

• Added a MeetingRegistration.attended field, to keep apart attendance
  at a meeting and registration for a meeting.

• Updated meeting attendance and nomcom eligibility calculations to take
  the MeetingRegistration.attendance flag into account.

• Added some code to set the meeting attendance flag when Meetecho pulls
  OAuth2 profile data for session participation between the start and end
  dates for a meeting.

• Updated the api_new_meeting_registration() endpoint to set all provided
  fields correctly. Fixes a bug that left some fields unset.

• Expanded the test case for api_new_meeting_registration() to test both
  the existing and new account case, and test that additional table fields are
  set appropriately.

• Merged in [17908] from rjsparks@nostrum.com:
  Added used_roles to Group and default_used_roles to GroupFeatures.
  Dynamically build the group edit form to provide a field for all
  used_roles. Fixes #2785 and #2572. Partially addresses #2160.

• Added hourly generation of two static files: 1wg-charter*.txt

Coverage

Summary: API for account creation triggered by meeting registration
Release Date: Mon, June 8, 2020 at 8:17 PM UTC
Release Author: Henrik Levkowetz

• Added a new API endpoint to be used by the registration system, to trigger
  account creation.

• Refactored some account creation code to re-use the email sending part in
  the registration system notification api for new meeting registrations.

• Updated the email template that goes out for password setting on account
  creation, to give directions also for the case when the user already has a
  pre-existing account. Updated a test to match.

• Added a showapikeys management command, to be able to easily list existing
  API keys.

• Added a migration to create login and person records for the new
  mail-archive and registration-system accounts.

• Added a new role Robot, for use with reg-system and mail-archive API
  accesses.

• Added reg_type and ticket_type to the MeetingRegistration model.

• Updated a patch for oidc_provider, to remove tzinfo in a default datetime
  value.

Coverage

Summary: Support for OpenID and OAuth2
Release Date: Sun, June 7, 2020 at 12:07 PM UTC
Release Author: Henrik Levkowetz

This release introduces support for OpenID and OAuth2, with out-of-band
client registration, and adds some other minor tweaks and bugfixes:

• Added OpenID support through django-oidc-provider, with tests using the
  certified python oic module.

• Added patches for some issues with the oic and oidc-provider modules,
  and updated a patch for request-profiler.

• Added a factory function OidClientRecordFactory for OpenID testing

• Added django urlconfig namespace support in
  ietf.utils.test.get_callbacks() (needed when testing the reverse lookups in
  templates for oidc_provider).

• Tweaked patch.py for Py3 compatibility.

• Tweaked log.unreachable() and log.assertion() for Py3 compatibility.

• Tweaked the meetecho access API fallback response to use person.plain_name
  instead of person.name.

• Added a download-only switch to docker/updatedb

• Decorated post_submission() with @transaction.atomic, and did some
  slight refactoring of code related to post_submission() calls and
  submission events. This was triggered by a submission left in an
  intermediate state because of a WSGI timeout (leading to a 504 error).

• Increased the required version of request-profiler and updated its
  patch file.

• Excluded a majority of htmlized drafts at /doc/html from the test-crawler
  (but keeping some for testing) in order to reduce the crawl time.

Coverage

Summary: Code sprint 107.1
Release Date: Thu, May 21, 2020 at 11:11 PM UTC
Release Author: Henrik Levkowetz

This was an online codesprint, held March 19. Thanks to all who
participated! There were some very good contributions:

• Merged in [17835] from pusateri@bangj.com:
  Add agenda_note and remote_instructions to agenda.json API. Fixes
  #2955.

• Merged in [17838] from fenton@bluepopcorn.net:
  Give IRSG at-large members balloting capability. Fixes #2979.

• Merged in [17843] from housley@vigilsec.com:
  Created a slowpages file cache for some very stable pages.

• Merged in [17864] from housley@vigilsec.com:
  Added /meeting//agenda pages to the slowpages cache. Also limited
  display of the agendas are subject to change notice to the current
  meeting's agenda. Fixes #2992.

The release also contains some commits made just before or after the
code sprint:

• Added a missing guard against attribute access on None.

• Changed the nomcom chair help page to show 4-digit years, rather than
  2-digit years in templates and examples.

• Renamed some view funtions for consistency. Almost all .json enpoints
  were named *_json(), but not all. Fixed in this commit, together with the
  equivalent renaiming for one .ical endpoint.

• Refined the makeresources management command slightly to improve
  handling of models with names ending in Resource -- tastypie requires the
  resource name to be explicitly set in this case.

• Updated the NomCom eligibility calculation to use the last 5 in-person
  meetings, in accordance with draft-iesg-nomcom-eligibility-2020-03 which
  has now been approved for publication. The code will need revisiting when
  the long-term policy is available.

• Merged in a patch from mark@painless-security.com to add caching
  options to docker/run

• Changed the wording in one place on the NomCom Chair help page so as to be
  in line with menu entry and page title of the NomCom Settings page, based
  on feedback from Barbara Stark.

• Added a utility script docker/rsync-extras to populate a dev instance with
  drafts, rfcs, slides, etc.

Coverage

Summary: Upgrade to Django 2.0
Release Date: Wed, May 20, 2020 at 9:33 AM UTC
Release Author: Henrik Levkowetz

This release moves the datatracker on to the Django 2.0 framework, from the
earlier Django 1.11. Further upgrades to Django 2.1 and 2.2 will follow.
The major version bump is motivated by not being able to run under Python 2.x
and Django 1.x any more.

There are also some other minor changes:

• Merged in ^/personal/henrik/6.129.2-django2.0 which contains an upgrade
  of Django from 1.11 to 2.0, with the accompanying code changes needed.

• Added a template with-clause that was lost in merging.

• Merged in [17803] from rcross@amsl.com:
  Made various changes to session request form, mostly removal of fields, in
  order to support virtual session requests.
  Also added settings.SECR_VIRTUAL_MEETINGS list.

• Fixed a test that incorrectly looked for author.name instead of
  author.plain_name()

Coverage

Summary: Bugfixes
Release Date: Mon, May 18, 2020 at 4:46 AM UTC
Release Author: Henrik Levkowetz

From the commit log:

• Merged in [17797] from rjsparks@nostrum.com:
  Better use of group type in interim announcement tools. Fixes #2989.

• Refactored many instances of msg.get_payload(decode=True).decode('utf-8')
  and similar to get_payload_text(msg), which uses msg.get_charset() to get
  the actual charset to do the decoding in a consistent manner. Also
  removed some instances of force_str (but more remain).

• Added group chair/secretary role information to the personal meetecho
  key API return.

• Added a bunch of drafts for which we don't have text files to the
  test-crawler exclusion list.

• Fleshed out a review test slightly, and did some refactoring.

• Added an utility function to get email payload as unicode text.

• Merged in [17794] from mark@painless-security.com:
  Add the msg variable for interpolation on reviewer availability
  change emails, and reformat the add-a-period email. Fixes #2891.

• Merged in [17722] from mark@painless-security.com:
  Remove the experimental verbiage from the references / referenced by
  pages. Fixes #2857.

• Fixed a bug in upcoming() leading to entries before the current date
  being shown.

Coverage

Summary: Meeting services for IAB programs, meeting shortcuts in additional places, bugfixes
Release Date: Wed, May 13, 2020 at 12:21 AM UTC
Release Author: Henrik Levkowetz

Extracted from the commit log:

• Merged in [17764] from rjsparks@nostrum.com:
  Allow IAB programs to use normal meeting mechanics. Fixes #2970.

• Based on [17694] from mark@painless-security.com, this merges in a set
  of changes that provides agenda-like details on session meeting view, and
  fixes issue #2751. It also aligns the styling of materials and resources
  link lists on the upcoming meetings and ietf agenda pages, and adds
  calendar symbols with links and recordings symbols with links to interim
  meeting pages.

• Added send-scheduled-mail to bin/every15min

• Reworded the instructions for submission tool bug reporting and manual
  posting to avoid reports going to the wrong address.

• Added missing notify-expirations script to bin/weekly

• Added a catch for malformed apikey input.

• Fixed a case of too few format string parameters.

• Tweaked a 404 message to differentiate between two not-found cases.

• Updated the buildbot config with additional builders, database loading
  as part of test-crawler run, tweaked test-crawler start-time and other
  tweaks

• Added a second link to htmlized draft content (on the datatracker) in
  addition to the link to the tools hosted htmlized document.

• Fixed some instances of invalid html.

Coverage

Summary: Bugfixes
Release Date: Wed, May 6, 2020 at 1:30 PM UTC
Release Author: Henrik Levkowetz

• Merged in [17711] from henrik@levkowetz.com:
  Turned autoescape off for another email fragment template (production
  database has also been changed). This fixes an issue where
  test_assign_reviewer() would sometimes fail due to html-escaped characters
  in email text.

• Merged in [17725] from rjsparks@nostrum.com:
  Add help text strongly encouraging always having a conference link in
  any interim request. Fixes #2973.

• Merged in [17724] from rjsparks@nostrum.com:
  Use normal material management permissions for uploading bluesheets.
  Fixes #2975.

• Merged in [17723] from rjsparks@nostrum.com:
  Stop requiring AD approval of virtual interims. Fixes #2972.

• Merged in [17712] from rjsparks@nostrum.com:
  Add a webcal link to /meetings/upcoming. Partially addresses #2971.
  Adding this to the main agenda page will require some js juggling, and I
  think getting some runtime with it first to make sure it is what we want
  makes sense.

• Merged in [17709] from rjsparks@nostrum.com:
  Modified the last-call announcement template, at the IESG's request,
  removing the link to documment's ballot (which may not exist at the time
  last-call goes out). Fixes #2967.

• Merged in [17708] from rjsparks@nostrum.com:
  Remove point raised - writup needed from the set of substates the
  IESG can use with a document. Fixes #2968.

• Added a first iteration of /meeting/upcoming.json for Meetecho use,
  with the expectation that buildout and tweaks may be required.

• Limited the data for New draft revisions over time on the personal
  profile page to type='draft'. This fixes an issue where other document
  types, for instance reviews, would be counted.

Coverage

Summary: New meeting schedule editor
Release Date: Fri, May 1, 2020 at 9:04 AM UTC
Release Author: Henrik Levkowetz

This provides the first release of the new meeting schedule editor which
lets the Secretariat and IESG lay out the week's schedule for in-person IETF
meetings on a visual grid. The new editor is based on experience gained
with the current schedule editor. In addition to visual and functional
improvements, the underlying javascript and ajax API has been thoroughly
revised.

• Merged in ^/branch/iola/meeting-improvement-r17214@17617, which
  provides a new meeting schedule editor.

• Minor housekeeping changes

Coverage

Summary: Changes in nomcom eligibility code, IPR handling, CI buildbot, and API keys
Release Date: Mon, April 27, 2020 at 7:10 PM UTC
Release Author: Henrik Levkowetz

From the commit log:

• Changed meeting links to etherpad instances to use port 9009, in order
  to avoid web server proxying, which can cause issues under load.

• In IPR disclosure statement updates, don't show links to parked IPR
  declarations, since they will 404.

• Fixed a server 500 on missing flooplan image file, which should have
  returned a 404.

• Changed the date/datetime at the top of meeting session pages to indicate
  timezone, and be given in UTC for virtual interim meetings, but meeting
  timezone with UTC in parentheses for in-person meetings. Fixes issue
  #2963.

• Enhanced [17687] slightly, adding rendering of other status settings than
  cancelled, and adding warning background for cancelled. See issue #2963.

• Added a template filter that is a replacement for Django's builtin date
  filter, with a more polymorphic signature: It accepts either datetime or
  date input, and ignores time-specific format entries when handling a date.

• Fixed a html closing tag error.

• Gave docker/updatedb a --quiet flag for use with buildbot, and fixed an
  issue with error reporting of bad script switches for docker/updatedb.

• Moved minimum version up for python-magic, due to a Py3 issue with earlier
  versions.

• Fixed a number of Py2/Py3 issues and removed more Py2 compatibility code.

• Updated some minimum versions for required packages.

• Merged in [17663] from rjsparks@nostrum.com: Show recent meetings on a
  group's meeting tab even if there aren't other past meetings. Fixes #2961.

• Added an explicit dependency on svn. Under py3 it can be installed
  with pip, and doesn't need OS packages for python-subversion (it still
  needs libsvn1, though).

• Updated buildbot in a number of respects, in order to be able to deploy
  Py3 workers:

  • Added the possibility of specifying worker path on the command line for
    the restart-workers script

  • Added a buildbot_passwords template

  • Removed excess workers

  • Updated the buildbot master config file.

  • Updated buildbot workers from 0.8 to 2.7, transitioned to Python 3, and
    added some convenience scripts.

• Merged in [17649] from rjsparks@nostrum.com: Follow RFC8713 section 4.15
  for roles that disqualify for nomcom. Fixes #2944.

• Merged in [17650] from rjsparks@nostrum.com: Refactored
  nomcom-disqualifying roles into one place.

• Added a request profiler and a management command to purge profiler
  records.

• Added template fragment caching for the upcoming meetings page.

• Tweaked the group closing notes edit line for the secretariat on the
  group about page.

• Changed the use of requirements3.txt in docker files back to
  requirements.txt, and removed requirements3.txt

• Added a personal API key for meetecho access.

• Added the meetecho access api key to the list of personal API keys
  available through the Personal API GUI, and removed a secretariat-only key
  from the list.

• Added a migration for the updated list of personal API endpoints.

• Simplified the URL and view code for the personal meetecho access API
  endpoint, and added test code.

• Refined the GUI for personal API endpoints so that endpoints for which one
  does not have the right Roles do not show in the GUI, and added a
  supporting method on Person objects. Updated tests accordingly.

• Updated the API v2 JsonExporMixin to not try to use an API key argument as
  a queryset argument when building the json response.

• Added exception handling in the require_api_key() decorator for
  AttributeError raised by the decorated function.

Coverage