Voting Methods Working Group (VMWG)

Voting Methods Standard

Purpose

The purpose of this guidance and standard is to enable adopters to produce correct and accurate determination of outcome of government operated elections in US government jurisdictions. This guidance and standard enables manufacturers, elections administrators (EA), elections officials (EO), elections analysts, testing and certification labs, and informs the Technical Guidelines Development Committee (TGDC) of the Election Assistance Commission (EAC) and future versions of the Voluntary Voting System Guidelines (VVSG), and other stakeholders including the general public. This guidance and standard supports Data Interoperability (DI) and data integrity, and enables EA systems to be valid to a high degree of confidence, accurate, fail-safe and cost effective.

To achieve Data Interoperability(DI), this guidance and standard enables stakeholders to architect elections administration systems where the characteristics of calculations performed are precisely known for components, sub-systems or systems, and across systems where data flows or where data is collected and analysed separately. Adoption of this standard enables DI within a jurisdiction's systems and also inter-jurisdictional data and multiple-jurisdiction data aggregation and analysis, and may also apply to testing and certification.

Status

https://docs.google.com/document/d/e/2PACX-1vT0LbAOS-7DgPEygXzEvLFWfJquHgTEdnnkG8s8i995wcokSKNIpLiPDMfR3AFywmE4gILSPuubpAbC/pub#id.8fqjoj40frpl VMWG Draft NIST SP 1500-107 Voting Methods Models, Appendix G Glossary 2018 Q3-Q4
https://github.com/usnistgov/VotingMethods/tree/master/Tabulation April 2018
Tabulation Process Flow Diagrams
2018-04
2018 Presentation Slides - Coming Soon 2018
Presentation Slides
2018-
VM-WG Draft NIST SP 1500-107 Voting Methods Models 2018 - Coming Soon VMWG Draft NIST SP 1500-107 Voting Methods Models 2018 2018
Q2-Q3 2018 VMWG Roadmap Q2-Q3 Roadmap 2018
NIST_TGDC_Interop_Presentation_VotingMethodsWG_V5_5_20170907_Lochridge-et-al Sept. 2017 Presentation Slides 2017-09-08
NIST 1500-X Voting Methods Models Draft Outline Sept. 2017 NIST 1500-107 Voting Methods Models Draft Document, Outline 2016-09-23
DRAFT TGDCPresentation_VotingMethodsModels_V3_20160831_LML.pdf VM-WG Draft 2016 Slide Deck 2016-08-31
New: Github rep at usnistgov/VotingMethods Voting Methods Public Repository: 2016

About


VMWG meets periodically. Our membership is formed of experts and a variety of stakeholders including elections officials, elections administrators, manufacturers, software and service providers, ISVs, academicians, researchers, organizations and NGOs, and analysts.

Subgroups of VMWG form as needed to complete work product and deliberate as subject matter experts. Subgroups of VMWG form as needed and meet for status, deliberation, and to produce technology architecture, reference architecture, reference implementations, rapid prototypes for proof of concepts, and other work product and artifacts.

VMWG is a subgroup of NIST Interoperability. Some of our VMWG members are also participants of the other working groups developing standards, requirements recommendations and guidelines with NIST Voting and to inform the NIST Technical Guideline Development Committee (TGDC), which in turn informs the Election Assistance Commission (EAC).

The VMWG team and members participate in NIST CyberSecurity WG, Election Business Process Models WG, Testing WG and contribute to the development of other work product including standards for Cast Vote Records, Election Results Reporting, Election Logging, NIST VVSG Glossary, and more.

The standard, specifications and guidance that VMWG produces adopt or are consistent with the standards, specifications and guidance that are produced by the constellation of other working groups, and other NIST standards.

The VMWG team is primarily concerned with Voting Methods, Tabulation Methods, the Data Integrity (DI) and Data Interoperability of vote selection data sets representing ballots, and the common format for operations on vote selection data sets.

Voting Method

A voting method encompasses a set of partially ordered process steps, tabulation methods and rules. Each voting method has at least one associated tabulation method and at least one election outcome decision rule set containing at least one decision rule. A decision rule set is applied to produce an election contest outcome.

Tabulation Method

A tabulation method is a set of partially ordered process steps and operations for performing counting, summing, accumulation, and other data and math operations. Data and math operations include but are not limited to: vote counting, reporting of numeric results, reporting of statistics, or other election ballot marks and contest counting or tally data operations. Tabulation counting and data operations may be performed for a variety of purposes, or use cases, including but not limited to audits, end-to-end verification, logic and accuracy testing (L&A testing).

VMWG ongoing activity includes but is not limited to rapid prototyping and producing work product as follows.

  • Rigorously and precisely defined models of voting schemes, voting methods, or modules where counting, tabulation, mathematical evaluation, or common operations on vote data sets are performed in Elections Administration (EA) systems.

  • A prototype process for knowledge acquisition and representation of EA counting and tabulation methods from the rules and guidelines for administering elections. EA processes are typically specified in written legislation, statute, rules, and guidelines, or Request For Proposals (RFP) produced by Elections Officials (EO). English, or any spoken and written language is naturally less precise than a mathematical specification. Specifically, this process extracts the specification of counting and tabulation methods from plain language legislation and rules and represents the counting and tabulation methods as mathematical models and process models.

  • Use Cases

    Use cases include auditing, aggregation & roll-up, end-to-end verification, evidence procedures, capacity planning, testing, certification testing, security, information privacy, logging & tracing, common vote selection data set operations, legislative specification, Election Official's specifications for RFIs and RFPs.

  • Reference Architecture, Reference Mechanized Voting Method Models, Tools and examples, reference implmentation of verifiable tabulation and voting methods engines.

  • Precise specifications for optional and voluntary use in Legislation and Elections Officials Rules and Guidelines, currently in draft as NIST SP 1500-107.
Applications of this Voting Methods Models specification are consistent with NIST VVSG Interoperability guidelines or requirements and Common Data Format (CDF) specifications and requirements produced by other NIST Voting or VVSG groups, including Cybersecurity.

Executive Summary

The NIST Voting Models Working Group (VMWG) produces this Voting Methods Models Standard to enable data interoperability and data integrity in the architecture of elections administration (EA) systems and for application to testing and certification of EA systems. This standard seeks to enable stakeholders to architect or analyze elections administration systems where the characteristics of calculations performed are precisely known for components, sub-systems or systems, and across systems where data flows or where data is collected and analyzed separately. Adoption of this standard enables Data Interoperability within a jurisdiction's systems and also inter-jurisdictional data and multiple-jurisdiction data aggregation and analysis, and may also be applied to testing and certification. It provides a set of rigorously and precisely defined mathematical models of voting schemes, voting methods, or modules where counting, tabulation, mathematical evaluation, or common operations on vote data sets are performed in Elections Administration (EA) systems, and provides a process for knowledge acquisition and representation of EA counting and tabulation methods from the rules and guidelines for administering elections. Data Interoperability (DI) is complementary to Data Interchange or Transport Interoperability and both enable EA systems to be, valid to a high degree of confidence, accurate, fail-safe, and cost effective.

Abstract

This publication describes a standard for precise specification of elections administration voting methods and mathematical evaluation modules, including counting and tabulation. This specification is a set of voting methods elements where each element is a voting method mathematical model, with its corresponding unique identifier and description. Each element is a precise definition which can be referenced without ambiguity, reused, and understood by a variety of stakeholders including legislators, elections officials, analysts, systems and software manufacturers, and those performing testing and certification. Adoption of this standard supports vote selection Data Interoperability through a Common Data Format. This specification includes a reference implementation of select voting methods and description of the methodology for knowledge acquisition and representation for domain modeling of counting and tabulation methods.

NIST SP 1500-107, initial version 1.0 is expected to be complete for VVSG 2.0in the following parts.

● Set of common format modules for operations on vote selection data sets, representing the plain language algorithmic definitions in U.S. elections legislation, rules, guidelines, for voting methods, as precise mathematical logic specifications, each with description and unique identifier, for the subset of all voting methods that are complete in each specification version.

● UML model of voting methods modules domain, mapped to the Elections Modeling business process model framework. The Elections Modeling sub-group of NIST Voting, Interoperability, is a peer to VMWG, and may be found here: http://collaborate.nist.gov/voting/bin/view/Voting/ElectionModeling

● Use Cases

● Reference Architecture

● Reference implementation including a set of packaged tools and examples for validating modules in a particular configuration or use case

See also the Sept. 2017 Presentation slides in the table of Status documents (above), for a current overview.

See also: https://github.com/usnistgov/VotingMethods *

*We're in the process of updating our github repository

Officers

VM-WG Co-Chair & Editor: Lauren Massa Lochridge

NIST Co-Chair: John P. Wack

VM-WG Co-Chair for Auditability and Risk Management: Philp B. Stark

VMWG Membership

  • Lauren Massa Lochridge, Working Group Co-Chair
  • John P. Wack, NIST Co-Chair
  • Philip B. Stark, Co-Chair for Auditability and Risk Management, Associate Dean, Division of Mathematical and Physical Sciences |Professor | Dept of Statistics | UC Berkeley
  • Herb Deutsch, ES&S
  • Joseph Kiniry, Galois and Free & Fair
  • Carsten Schurmann, IT University of Copenhagen
  • Kimball Brace, Election Data Services, Inc.
  • Kenneth Bennett, Los Angeles County, CA
  • David Buerger, Elections Specialist Wisconsin Government Accountability Board, WI
  • John Dziurlaj, Office of Secretary of State, OH
  • Barbara Simons, Former President ACM, Former EAC Board of Advisors
  • Olivier Pereira, Catholic Universityof Leuven
  • Peter Ryan, University of Luxembourg
  • Chris Jerdonek, Elections Commissioner & President of the City & County of San Francisco Elections Commission, CA
  • Tammy Patrick, Senior Advisor to the Democracy Project, Bipartisan Policy Center
  • Don Rehill, Dir. Elections Research and Vote Tabulation, Associated Press
  • Benjamin Rice, Dominion Voting
  • Steve Schneider, Asooc. Dean, Director, Surrey Centre for Cyber Security University of Surrey
  • Beth Ann Surber, West Virginia, Office of Secretary of State, WV
  • Chris Jackson, Ipsos Public Affairs
  • Arthur Keller, Computer Engineering department, University of California, Baskin School of Engineering
  • Lynn Garland, Independent
  • Michael Greenman, VP of Emerging Technology & Corporate Development, SOE, a Scytl company
  • Neal McBurnett, ElectionAudits
  • Art Griesser, Prometheus Computing
  • Vanessa Teague, University of Melbourne, Dept. of Computing and Information Systems
  • John Rose, Maxim Consulting, Inc., a Scytl Company
  • Ron Rivest, MIT
  • George Gilbert, Former BOE Director, NC
  • Chris Hughes, FairVote
  • David Wallick, Votem
  • Observers

  • Poorvi Vora, GWU
  • Sarah Whitt, Wisconsin Elections Division
  • David Becker, Center for Elections Innovation & Research
  • Jared Marcotte, Open Source Advocate, Developer, and UX Strategist
  • Justin Moore, Google, Voting Information Project
  • Rob Richie, FairVote
  • Jameson A. Quinn, Harvard

    *Note: Affiliations where given are for the purpose of identification only.

Websites

Wiki URL: http://collaborate.nist.gov/voting/bin/view/Voting/Interoperability

Voting Methods Working Group: http://collaborate.nist.gov/voting/bin/view/Voting/VotingMethodsModels

Voting Methods Public Github Repository: [under construction] VM-WG Public Git Repo

Email List

Email: voting-methods@list.nist.gov

To join the list or find more information about list policies and related procedures, please visit the VVSG Working Group Lists page.

Documents

Definition:

Policies and Procedures:

Reference Architecture:

Work To-Date:

Technology Roadmap:

Vocabulary:

Publications:

--
Lauren Massa Lochridge - 2015-11-18

This Topic Is Referenced By



FrequentlyAskedQuestions
FridayOct28
Interoperability
WhyIsACDFNeeded

Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf NIST_TGDC_Interop_Presentation_VotingMethodsWG_V5_5_20170907_Lochridge-et-al.pptx.pdf r1 manage 3215.1 K 2017-09-08 - 17:51 LaurenMassaLochridge NIST_TGDC_Interop_Presentation_20170907_Lochridge_et_al
PDFpdf TGDCPresentation_VotingMethodsModels_V3_20160831_LML.pdf r1 manage 221.4 K 2016-09-14 - 16:02 LaurenMassaLochridge 2016-08 Draft VMWG NIST 1500-X & Draft Slide Deck
PDFpdf VMWG_NIST_SP1500-DRAFT_20160923_LML.pdf r1 manage 226.2 K 2016-09-24 - 06:22 LaurenMassaLochridge 2016-09 Draft VMWG NIST 1500-X
PDFpdf VMWG_NIST_SP1500-DRAFT_201609_LML.pdf r1 manage 224.4 K 2016-09-14 - 16:02 LaurenMassaLochridge 2016-08 Draft VMWG NIST 1500-X & Draft Slide Deck
GIFgif logo.gif r1 manage 3.4 K 2015-10-02 - 14:31 BenjaminLong  
Edit | Attach | Watch | Print version | History: r40 < r39 < r38 < r37 < r36 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r40 - 2018-10-09 - LaurenMassaLochridge
 
This site is powered by the TWiki collaboration platform Powered by PerlPLEASE NOTE: This wiki is a collaborative website. NIST does not necessarily endorse the views expressed, or concur with the facts presented on these sites. Further, NIST does not endorse any commercial products that may be mentioned on these sites. All the material on this website is in the public domain, including any text, diagrams, or images, unless indicated explicitly. Don't share anything on this site that you do not want to be public. Do not pass any proprietary documents or put any on the TWiki with implied public disclosure. If you do, it shall be deemed to have been disclosed on a non-confidential basis, without any restrictions on use by anyone, except that no valid copyright or patent right shall be deemed to have been waived by such disclosure. Certain commercial equipment, instruments, materials, systems, software, and trade names may be identified throughout this site in order to specify or identify technologies adequately. Such identification is not intended to imply recommendation or endorsement by NIST, nor is it intended to imply that the systems or products identified are necessarily the best available for the purpose. Any data provided on this site is for illustrative purposes only, and does not imply a validation of results by NIST. By selecting external links, you will be leaving NIST webspace. Links to other websites are provided because they may have information that would be of interest to you. No inferences should be drawn on account of other sites being referenced, or not, from this page. There may be other websites that are more appropriate for your purpose.