Summary: Expanded group property table entries
Release Date: Mon, February 4, 2019 at 11:57 AM UTC
Release Author: Henrik Levkowetz

This release contains a refactoring of a large number of instances in the
code where group types (wg, area, rg, etc.) have been hardcoded in the past
in order to reflect different properties for different groups. Instead,
group types have now aquired a list of new feature settings, for instance
is_schedulable, show_on_agenda, has_session_materials, and more. This will
make it easier to add new group types without having to change the code,
by indicating for each new group type which properties it should have.

Additionally, some minor unrelated fixes has been applied. From the
commit log:

• Merged in GroupFeatures refactoring and expansion from
  ^/personal/henrik/6.89.4.dev0@15911.

• Reverted r15071 with respects to showing the submit for publication
  button to shepherds. Fixes issue #2673.

• Updated code and templates to use the new docman and groupman group
  features.

• Updated fixture with new group features and more.

• Added a tiny management command to list group types per feature.

• Removed origin information from the liaison_title.html template, as
  it's used in a context where html comments will be rendered. Fixes issue
  #2674.

Coverage

Release Date: Mon, January 21, 2019 at 11:49 AM UTC
Release Author: Henrik Levkowetz

• Modified the rolodex code to make sure we capture information about the
  origin of newly added email addresses. This requires the secretariat to
  be clear about where new email addresses come from, in order to be able to
  remove them if we later receive a GDPR personal data deletion request.

• In the draft metadata extraction code, moved the future imports down
  so as not to obscure the module docstring. Fixes the earlier inability to
  run $ ietf/utils/draft.py -h.

• Applied a series of patches for python 3 compatibility from
  dkg@fifthhorseman.net to the draft metadata extraction code:

  • Use a list of dictionary keys. In python3, dict.keys() produces a
    dict_keys object, not a list. Since this code treats it as a list,
    we'll just be explicit about that.

  • Fix regex manipulation for word characters. In python 3.7, re.sub()
    started treating unknown escape sequences in as errors. Fix this by
    sending an escaped \ where we mean to pass it through raw.

  • Use // for explicit integer division. Without this fix, in modern
    versions of python, the changed line produces: TypeError: float'
    object cannot be interpreted as an integer'.

  • Use modern form of exception handling.

  • Use the print function instead of print statement.

• Added more name normalization for test factory person names.

Coverage

Release Date: Mon, January 14, 2019 at 3:25 PM UTC
Release Author: Henrik Levkowetz

• Updated the timezone information to match the latest timezone database
  release (2018i)

• Merged in [15865] from rjsparks@nostrum.com:
  Cleanup: removed the infrastructure for importing reviews from the
  old review tool.

• Merged in [15864] from rjsparks@nostrum.com:
  Refactored DocumentInfo to address overloading the external_url field
  with strings that are not URLs.

• Merged in [15846] from rjsparks@nostrum.com:
  Simple tests of some log utilities.

• Merged in [15845] from rjsparks@nostrum.com:
  simple test of BowerStorageFinder.

• Merged in [15833] from rjsparks@nostrum.com:
  Incremental improvements to the submit_existing tests.

• Merged in [15829] from rjsparks@nostrum.com:
  Make state/substate changes on new submissions sensitive to stream.
  Fixes #2642.

• Merged in [15828] from rjsparks@nostrum.com:
  Show more group types on the concluded groups page. Fixes #2643.

• Additional tweaks to submission yang testing and the test runner

• Updated PLAN

Coverage

Release Date: Wed, December 19, 2018 at 8:27 AM UTC
Release Author: Henrik Levkowetz

• Added a migration to capture changes to HistoricalRecords triggered by
  changes in django-simple-history

• Bumped the minimum version requirement on django-simple-history;
  HistoricalChanges which we now use was introduced with 2.3.0.

• Changed the construction of element IDs that could trigger ad-blockers
  in a NomCom page to avoid the problem.

• Removed an assertion for iesg state for documents that can be in any
  stream.

• Merged in [15824] from rjsparks@nostrum.com:
  Make it more obvious that a group has been replaced when looking at its
  pages. Fixes #2661.

• Merged in [15818] from rjsparks@nostrum.com:
  Whitespace only change to make the conditional structure followable.

• Merged in [15822] and [15809] from rjsparks@nostrum.com:
  Added an explicit ID-Exists state for the IESG state machine.
  Reworked code so that the IESG state machine always has a state.
  Added the ability to release a document from a working group,
  research group, or the independent stream. Releasing a document
  removes all stream state, and sets the document to have no stream.

• Fixed a bug in the RFC Index parsing that caused extraction of only one
  paragraph of an abstract, even if there were multiple.

• Merged in [15816] from rjsparks@nostrum.com:
  Provide a correct link to jabber logs for plenaries in past agendas.
  Fixes #2641.

• Merged in [15810] from rcross@amsl.com:
  Grant secretariat admin permissions to mailtrigger models. Fixes
  #2637.

• Merged in [15808] from rjsparks@nostrum.com:
  Allow notify_ad_when to be blank.

• Merged in [15807] from rjsparks@nostrum.com:
  Repaired another instance of a literal path with a reverse lookup.
  Related to #2657.

• Added a description of the /doc//doc.json API to the /api/ index page,
  and also added a table-of-contents column.

• Merged in [15806] from rjsparks@nostrum.com:
  Changed an inappropriate literal path to a reverse url lookup. Fixes
  #2657.

• Merged in [15804] from rjsparks@nostrum.com:
  Add history to ReviewerSettings. Fixes #2147.

Coverage

Release Date: Mon, December 3, 2018 at 6:09 PM UTC
Release Author: Henrik Levkowetz

• Merged in [15787] from rcross@amsl.com:
  Rework page flow and forms of secr/meetings app. Fixes #2609.

• Added code to catch a possible attribute error on event notification.

• Added two new management commands to make it easier to load back
  selected objects that have been removed by mistake (providing they are
  available in a full database dump or backup that can be loaded and worked
  with): dumprelated and loadrelated.

• Increased the document limit from 200 to 500 for the AD documents page.

Coverage

Release Date: Tue, November 20, 2018 at 4:30 PM UTC
Release Author: Henrik Levkowetz

This release provides improved export of statistics charts and data,
improved and more consistent test coverage, and fixes a few bugs:

• Fixed an issue with the To: and Cc: addresses of extra review email to
  responsible AD.

• Changed the liaison tool From: address to statements@ietf.org.

• Always show the liaison submitted date on liaison pages

• Added testing of unidecode_name() and name_parts(), in order to not rely
  on random name generation to excercise all paths.

• Updated highcharts from v4.2.7 to v6.2.0, and added support for CSV export
  from charts. Also tweaked the look of the highcharts context menu
  separators.

• Added handling for an EOF exception that can occur when using the
  django file-based cache.

Coverage

Summary: IETF 103 code sprint
Release Date: Tue, November 13, 2018 at 9:47 AM UTC
Release Author: Henrik Levkowetz

This release contains datatracker bug fixes and enhancements from the
IETF-103 Code Sprint. Again, this looks to be a sprint with an extremely
large number of contributions. Thanks to everyone who contributed!

Notable improvements:

Reviewer statistics are now more readable. Reasons for reviewer
unavailability is now only shown to authorised persons. It is now possible
to set a mail alias for review group secretaries, instead of having
individual mails sent on updates. AD notifications about reviews can now be
controlled better and the default settings are better tuned. Import of
review text from mailing lists should now handle zero search results better.

Logging in is now possible using all active email addresses registered for
an account, not only the primary login name.

Inaccurate, misspelled or misleading text has been fixed for a number of
web pages and email messages.

Additionally, a large number of individual bugs has been squashed:

• Merged in [15722] from rcross@amsl.com:
  Added a link to meeting/../agendas/list. Fixes #2627.

• Merged in [15720] from rjsparks@nostrum.com:
  Invalidate the get_state_slug cache when the get_state cache is
  invalidated. Fixes #2630.

• Merged in [15719] from rcross@amsl.com:
  Removed resources field from secr/meetings/../rooms. Tweaked CSS for this
  page to eliminate horizontal scrolling. Includes new base templates to
  facilitate transition to bootstrap. Fixes #2628.

• Merged in [15717] from rcross@amsl.com:
  Reworked the buttons on secr/meetings. Fixes #2629.

• Merged in [15715] from rcross@amsl.com:
  Fixed the issue where new non-session location field value wasn't saved.
  Fixes #2625.

• Merged in [15709] from rjsparks@nostrum.com:
  Show counts on the active groups page and on the active WGs page. Fixes
  #2060.

• Updated the script to fix ambiguous time stamps so that it will fix
  ambiguous time fields for additional types of objects.

• Added a test for various name part combinations, and fixed a couple of
  issues with utils.name.name_parts(), making the test coverage percentages
  more stable.

• Added exclusion of cancelled session when doing audio file import. This
  fixes an server 500 error when a cancelled session is shown in the same
  room and time slot as an actual session.

• Corrected the rendering of non-ASCII email names in nomcom templates.

• Merged in [15708] and [15730] from housley@vigilsec.com:
  Added a mail alias for all review team secretaries. Fixes #2139. Use
  the alias if there is one for email about review request changes. Added
  a test for the review team secretary alias functionality.

• Added a test that checks the mailarch search failure return, and tweaks
  the no-result return handling.

• Merged in [15706] from kivinen@iki.fi:
  Added easier to detect error message when search returns 0 results.
  This currently parses HTML result from the mail archive system, but when we
  get proper API to mail archive system it should be changed to do that
  instead. Fixes #2126.

• Merged in [15705] from johnl@taugh.com:
  Trivial fix for trivial issue #1907, warn user that added addresses
  will be confirmed.

• Merged in [15702] from johnl@taugh.com:
  Allow email as well as username when logging in.

• Merged in [15701] from kivinen@iki.fi:
  Changed format of the reviewer statistics in lists. Fixes #2131.

• Merged in [15683] and [15699] from housley@vigilsec.com:
  Do not show reasons for review team member unavailability outside the team.
  Fixes #2614.

• Added normalisation of the email addresses returned by
  ietf.nomcom.utils.parse_email, in order to not treat feedback from the same
  person as coming from different sources due to email name+address
  variations.

• Merged in [15698] from rjsparks@nostrum.com:
  Notify the RFC Editor when an RFC Editor note is changed after a draft
  has been approved. Fixes #2440.

• Merged in [15696] from peter@akayla.com:
  Minor text fixes. Fixes issue #2621.

• Merged in [15694] from rjsparks@nostrum.com:
  Clearly label cancelled sessions on the week-view on the agenda page.
  Fixes #2619.

• Merged in [15693] from mahoney@nostrum.com:
  Fixed link to webex request page. Fixes issue #2564.

• Added a guard against getting the attribute of None in
  api_set_session_video_url(). Fixes a server 500 for some hackathon
  sessions.

• Provided a tool-tip with full time information for the document history
  dates.

• Merged in [15689] from mahoney@nostrum.com:
  It need not be an error to find duplicate person records, such as for
  instance for Matt Larson. Took out the statement in the profile template
  that this is an error. Fixes issue #2616.

• Factored out some parts of the meeting/agenda.html into separate files,
  and added session buttons for other session (e.g., hotrfc)

• Merged in [15688] from mahoney@nostrum.com:
  Fixed bad variable in title of requests.html. Fixes issue #2608.

• Don't show slides in main IETF meeting agenda for sessions with their
  own session agenda.

• Merged in [15684] from rjsparks@nostrum.com:
  Removed the field and widget that made editing document states easier
  on the document admin page since they do not survive validation failure of
  other fields on the form. Excluded states from the model form since the
  default states widget is almost impossible to use without producing bad
  data. If states need to be edited through the admin, it will, for now, need
  to be done gruelingly through the admin form for State. Fixes #2524.

• Merged in [15681] from rjsparks@nostrum.com:
  Only do state-parent cross-validation on the group edit form when both
  fields are used on the form. (Many invocations of the form suppress all but
  one field.) Fixes #2597.

• Merged in [15679] from mahoney@nostrum.com:
  Verb tense used in Ballot Issued emails now matches whether the LC end
  date is in the past or future. Fixes issue #2482.

• Merged in [15677] from rjsparks@nostrum.com:
  Tune the recipients when a teams settings or a reviewer indicate ADs
  should be notified about a review.

• Merged in [15676] from rjsparks@nostrum.com:
  Let a reviewer indicate that an AD should give this review early
  attention. Fixes #2553.

• Merged in [15675] from rjsparks@nostrum.com:
  Let review teams opt in to poking a responsible AD when unhappy reviews
  are submitted. Fixes #2544.

Coverage

Release Date: Fri, November 2, 2018 at 2:51 AM UTC
Release Author: Henrik Levkowetz

This release contains one single fix, to give stable test results for
the test_edit_timeslot_type() test.

• Merged in [15648] from rjsparks@nostrum.com:
  Use only ietf meetings for testing editing timeslots.

Coverage

Release Date: Wed, October 31, 2018 at 4:13 PM UTC
Release Author: Henrik Levkowetz

This is a small bugfix release to clean the slate before the code sprint.
From the commit log:

• Merged in [15613] from rjsparks@nostrum.com:
  Make having a trailing slash optional for doc/html/docname. Fixes #2247.

• Merged in [15603] from rjsparks@nostrum.com:
  Changed some text and button labels to make the workflow for commiting
  group schedules more self-documenting.

• Clarified that the document search author field accepts also author
  affiliation as a search term.

• Removed microscopic photos from nomcom feedback page buttons. Few
  browsers render them correctly with badges, and they are too small to
  provide meaningful information.

• Changed the generation of the 1id-index.txt file to not list individual
  drafts in states Candidate for WG Adoption and Call for WG Adoption Issued
  as group drafts.

Coverage

Release Date: Mon, October 22, 2018 at 4:17 PM UTC
Release Author: Henrik Levkowetz

This is a bugfix release, whith the following changes:

• Merged in [15601] from rjsparks@nostrum.com:
  Corrected some DocTypeName entries' prefix value. Made the search code
  more robust against DocTypeName objects that have an empty prefix value.
  Fixes #2599.

• Merged in [15596] from rjsparks@nostrum.com:
  Improved coverage for several tests.

• Merged in [15595] from rjsparks@nostrum.com:
  Converted stats, submit, sync. and utils/test to use factories.
  Excluded utils/test_data from coverage checks.

• Fixed some incorrect topic audience id slugs, to make the NomCom topic
  availability filtering work correctly.

• Updated the nomcom reference from 3777 to 7437 on the Person profile edit
  page.

• Merged in [15580] from rjsparks@nostrum.com:
  Better constrain a liaison test object to match the preconditions for
  the test.

• Tweaked the mail sending routines' handling of the copy flag.

• Changed the mail sending routines so it's possible to not copy the
  debug archive on some messages.

• Added os.chdir() to virtualenv_activate to place us correctly to pick
  up patch files.

• Added Message-ID to log lines for sent email messages.

Coverage