VoteWell.net†† 20 March 2021
Comments & questions: admin@VoteWell.net
Trust Your Election Results?
Election officials don't check many results. Candidates and the public can monitor the election process and check results:
A. Get electronic copies of all ballots, by public record requests (more)
∑ Election machines already scan and make anonymous ballot images.
∑ Ask election officials to preserve these ballot images
B. Print and count these images of ballots, or get programmers to count them, to check official results. (more)
∑ Report any discrepancies. If there's an argument, courts decide.
∑ This one step will catch most errors in election results, caused by mistakes, dishonesty, or foreigners.
∑ This step also shows each candidate who else their voters chose, leading to alliances in the next campaign.
C. To be sure copies are reliable, compare a good sample of paper ballots to the electronic copies. (more)
∑ If copies aren't right, re-scan ballots with better scanners, release again, check again.
∑ If ballots are missing, so you can't check, it's a management failure. Inves≠ti≠gate and fix management.
A. A red, blue and yellow map shows the very limited audits each state requires, and you can read details for your state. When many contests are on the ballot, machine-counting is common, for accuracy and speed. Counting machines are computers. Even when they are offline, staff and contractors hand-carry annual updates to every machine, which can introduce errors and hacks.
2. Copies can be electronic or paper. Election machines make electronic copies of ballots, which are inexpensive to copy so candidates and the public can check results. If a jurisdiction has no electronic copies, scanners are inexpensive too, and can handle uncommon formats used in some jurisdictions.
3. Audit Elections USA lists which jurisdictions use vote-counting machines which can make electronic images of the ballots.
4. Getting copies depends on good relations with election staff, and/or requesting copies of the ballots or the electronic images under the relevant state Open Records Law or Freedom of Information Act (FOIA). Many states forbid copying ballots, but only a few forbid copying the electronic images, as shown on the map. A 2007 survey by the National Association of Secretaries of State identified policies then. Lawyers regularly analyze each state's Open Records or FOIA Law for the Reporters' Committee for Freedom of the Press.  There have also been some court decisions.† All these are summarized in the green and black map at the top of the page.
5. In states which have not had court decisions, it is important to ask lawyers for the best strategy. In the seven states which do not release ballot images, you may need a new state law.
6. When election machines create copies in unreadable proprietary formats, you can still request copies, then find another machine which can read them.
7. Sample FOIA letters are available. Requests can be sent directly or through a service like FoiaMachine, free, or MuckRock, $20 for up to 4 requests, which submits, follows up, and posts results online. Muckrock also shows the cumulative success rates of requests to each jurisdiction. States usually charge copying costs, which can be low for electronic copies.
8. States vary in how long they store local election ballots. Federal law requires that when any federal official is on the ballot, all ballots and other records must be kept for 22 months after each primary, general and special election.
9. An alternative of trying to check vote counting software directly is usually stopped by trade secrets laws. The alternative of using national exit polls is stopped by adjustments they do to match official results. Local groups have tried this approach. Exit polls do try to include mailed ballots as well as polling places.
10. Many states have groups working for better elections, which may help you.
1. The election staff or first recipients of the files need to calculate a digital signature or hash value to identify true copies of the scan. The hash value is a several-digit number, calculated from the ballot images, so any change in the file gives a different hash value, revealing that the file is not the same as the original. The hash value needs to be short enough to store and compare on paper, so it does not depend on computer storage, which can fail.
2. Humboldt County, CA, has scanned and counted ballots with open source software since 2008, several days after each election. Humboldt releases the ballot images with a digital signature or "hash value" for each file of ballot images.
3. There are several ways independent counts can differ from official counts and each other. Software has adjustable tolerances for partly filled ovals next to candidate names, and even for finding the ovals on the page. It can miss voters who marked an X or check-mark. If one set of software just checks for black ovals, it will miss votes where the voter circled the name instead, or wrote it in the write-in box. When circling or writing in counts as a vote under local and state law, the differences matter in close elections. Advanced software can also look for crossed-out votes where voters changed their minds, and their intent is clear.
4. Many jurisdictions use Ballot Marking Devices, a touchscreen where voters select choices, and the computer prints the choices on paper to put in the ballot box. The goal is to avoid letting voters mark ambiguous circles and X's, and to avoid the high costs and potential errors of commercially pre-printing blank ballots in multiple languages. The paper usually has a bar code or QR code summarizing the voter's choices, which is counted on election night. Errors in the code will be found if someone counts the printed names. Any error in the printed names is supposed to be found by each voter, but is caught only 7% of the time on a ballot with multiple contests.
5. Checking copies also lets people see if there are black or white lines or pale areas on the ballots caused by faulty scanning. Finding such problems may convince officials to conduct step C, or convince a court to order new better scans.
6. Legal structure stays the same, where county and city clerks and recorders manage the election, ballots and scanned images. People will report discrepancies to officials or courts as needed.
7. Ballot images need to become a standard part of campaigns, to verify counts and show the combinations of candidates which voters choose, helping design alliances for later campaigns.
8. An optional, sophisticated, step is to analyze the patterns of pixels in the images to detect tampering. If an error or hack shifts black ovals from one candidate to another, there could be discontinuities at the edges of the area shifted. Wisconsin's IT experts said "manipulation would be difficult; might be easy to detect, and may even be impossible."
9. Steps A and B will catch most errors and are useful even if you cannot do step C. Do not let the perfect be the enemy of good first steps. Without step C, outsiders can still check whether totals are correct. A and B force election thieves into a smaller space, where whistleblowers may catch them. Step C is harder and is only needed for sophisticated hacks in the images, moving black-marked ovals from one candidate to another, and to catch staff errors in reconstructing damaged ballots. Steps A and B are like locking your doors and windows. Step C is like stepping up to a home alarm system.
1. The number of ballots to check depends on budget, time, space, and how many staff can be well-supervised. Even a small sample of 200-500 ballots is enough to catch common errors. Suppose election machines report a victory margin of 2% (winner had 51% and loser had 49%). This result could be a mistake, if 1% or more of the scans were wrong. A random sample of 200 to 500 ballots has an 87% to 99% chance of finding at least one of those faulty scans, so the crook or the faulty machine would be found out.
2. Ideally checking would be done publicly by election staff right after each batch of ballots is scanned. For ballots scanned at precincts, a sample of each precinct can be compared to the images as soon as the ballot box comes back to the office. Both approaches identify faulty scanners immediately, so the ballots can be re-scanned and any preceding batches from that scanner can be double-checked.
3. Immediate re-scans of faulty batches fix multi-feeds and streaks from dirty sensors. If the cause is not so obvious, and affects two or more batches, all batches need to be re-scanned, to remove uncaught random errors in the other batches. 2-batch cutoff can be changed, but in a sample of 500 comparisons it gives 96% chance of catching errors affecting 1% of ballots and 70% chance for errors affecting 0.5% of ballots.
4. This small sample size is only reliable if you take seriously even two discrepancies, and either re-scan all ballots, or check a much bigger sample to search for more errors. Re-scanning is cheaper. Busy staff and candidates may want to ignore two lone discrepancies, but expecting to find more discrepancies in a small sample is unrealistic. Bugs in the scans (darkening a black oval to select one candidate rather than another), should never happen, and finding two means the entire scanned file is unreliable. In the example above, where 1% of scans were faulty, a sample of 200 has only 33% chance of finding 3 or more faulty scans. A sample of 500 is needed to get 88% chance of finding 3 or more faulty scans. If staff want to wait for 3 flawed scans before taking action, they need to examine at least 500 ballot images.
5. In jurisdictions with only a few hundred ballots, it is feasible and reassuring to check them all.
6. When people suspect errors in one area or type of ballot, these need to be sampled more heavily, or at 100%.
7. When errors are found, the ballots need to be re-scanned on different scanners. These can be scanners from the same election vendor, or commercial off-the-shelf scanners such as local offices already own. Then new files can be released to the public, and a new random sample can be selected and checked against the new ballot images.
8. This approach is a variation of a "Risk-Limiting Audit" (RLA). When a traditional Risk-Limiting Audit finds a problem, it expands the hand count, ultimately up to 100%. Rescanning gives the same assurance that results match the original ballots, while avoiding the cost and delay of 100% hand counts. Maryland rejected RLAs because of the unpredictable cost of hand counts, and they count scans instead, though they skip step C. Another weakness of traditional Risk-Limiting Audits is that they check only one or two contests, to minimize hand counts. Taking a little time to get verified scans makes it easy to check all contests. Finally, RLA requires a secure tally of verified electronic records, and traditionally the public has no evidence this tally is secure. Releasing ballot images lets the public check the tally.
9. Original ballots need to be kept in the same order they went through the scanner, to find the corresponding images. The alternative of printing numbers on ballots as they are scanned is touchy, since one does not want ink in the scanner which could be hacked to mark extra votes. Printing numbers can be safe if the only ink color in the scanner is one which voters don't use, like yellow or orange.
10. Ballots need to be compared immediately after random numbers are chosen, so there is no time for election thieves to change the stored originals which have been chosen. Even bringing the chosen ballots from a large storage room must be fast so the public knows there was no time for insiders to change them.
11. Numbers to identify ballots (3rd, 82nd, 209th, etc.) need to be truly unpredictable. If there is any chance of pre-selecting them, outsiders may suspect insiders of changing few selected ballots to match the already-released images.
12. Images need to be released before selecting the random numbers, so outsiders know that insiders could not fix just the few selected images to match stored ballots.
13. It is important for all supporters of losing candidates to see the audit has no holes, even after bitter campaigns.
14. When staff have reconstructed ballots after originals were torn or otherwise too damaged to be scanned, comparisons need to be done with the original ballots, not the reconstructed ones.
15. If there are doubts about any precinct or type of ballot, like reconstructed ones, it needs to be covered more thoroughly in the checking.
16. If the random comparison finds any mismatch between ballots and images, people need to decide if it could affect election results. Sporadic light ink may not matter, if it is always dark enough to read. Black or white lines through candidate selections matter, since they can hide voters' marks.
17. Comparisons need to be visible to the public, or they create little trust. The public can bring their own copies of the released image files. The hard part is letting them see the paper ballots. It is tempting to project these on a computer monitor, but if a savvy hacker has changed ballot images, she can hack a computer projection of paper ballots to match. An opaque projector which uses light and lenses rather than software would be trusted more.
18. All scanning and random comparisons need to be done as soon as possible after the election, ideally by the next day, since physically stored ballots are very much at risk of being changed. If storage seals are broken, few will have confidence that the ballots are still trustworthy. In hotly contested elections, partisans have guarded storage sites. For example in Bush v. Gore 2000, Republicans guarded storage in Florida and asked the state police to guard storage in New Mexico.
19. American governments spend $7 trillion per year. We choose these governments with an average of 100 million ballots per year, so an average ballot controls $70,000, half at federal level, half in state and local governments. Think of each ballot as worth $70,000. Treat and store boxes of ballots accordingly.
20. A word about precision. Poll workers report the number of voters, which should closely match the number of ballots in each precinct. A discrepancy of 3-4 ballots can happen in a busy precinct. I've been a poll worker. Voters are coming and going, getting regular ballots, provisional ballots, etc. and asking questions. However a discrepancy of 20-200 ballots needs an outside investigation, like any management failure or possible crime. If officials lose ballots or records, voters and law enforcement need to insist on better practices and new officials before the next election.
Like:††† †††††††††Comments & questions: admin@VoteWell.net
Map summarizing state rules for election audit is at http://site.votewell.net/a/map.png
An international group discusses wide-ranging election problems and procedures to address them. At this writing it seems to have been hacked(!), and an archive copy is at https://web.archive.org/web/20200416221039/http://aceproject.org/ace-en/
A US group offers expert answers to election questions https://electionverification.org/askanexpert/
 Hand-counting is more common in small towns and parliamentary democracies, where voters choose only one member of Parliament.
∑ Fujitsu fi7600 can process up to 200 meters of paper tape without cutting it, and can divide the image into sections of any length up to 220 inches. Normal speed is 100 pages per minute, or 850 inches per minute, so 300 feet in 4.2 minutes, $4,155.
∑ Contex IQ 2490 can pull paper through at 14 inches per second, so 300 feet in 8.6 minutes, $3,895
∑ HP T830 can process 4.5 inches per second, so 300 feet in 27 minutes, $3,245
Save money by rental, if possible, or by re-selling scanner after the election, or by transferring it to an office which would otherwise buy a new one.
Scanning rolls of music for player pianos is an avocation which has addressed some of these same issues.
 http://web.archive.org/web/20130217200102/http://www.nass.org/index.php?option=com_docman&task=doc_download&gid=95 NASS Survey on Cast Ballots as Open Records, Responses received as of March 29, 2007
 Reporters' Committee for Freedom of the Press https://www.rcfp.org/open-government-sections/i-election-records/
 Table of state laws and court decisions at https://commons.wikimedia.org/wiki/File:Ballot-foia.png#Summary
Discussion of Florida 2000: https://fair.org/extra/who-won-the-election-who-cares/
 Sample FOIA request language:
∑ SC 2020 county: http://votewell.net/sc-county.pdf
∑ †SC 2020 state: http://votewell.net/sc-state.pdf†
 52 USC 20701, formerly 42 USC 1974. Pages 75-79 of Federal Prosecution of Election Offenses have a detailed discussion, and mention criminal penalties up to a year in prison. Election officials must "take appropriate steps to ensure that those records will be preserved intact until such time as they may become needed to resolve legitimate questions that frequently arise involving the election process."
 Marlow, Burns (2017) Journal of Intellectual Property Law "Fundamental, Unequivocal, Yet Unreliable: The Interplay of Voting, Electronic Voting Systems, and Trade Secrets in Today's Interconnected World https://digitalcommons.law.uga.edu/cgi/viewcontent.cgi?article=1415&context=jipl
 Comparison of exit polls and official returns: https://web.archive.org/web/20170109194215/http://tdmsresearch.com/2016/11/10/2016-presidential-election-table/
 Local exit polls: http://protectcaliforniaballots.org/Pages/whatis.html
 Changing national exit polls: https://www.politico.com/story/2017/12/09/exit-polls-election-day-frustration-287913
Trachtenberg, Mitch. (2013-11-23). Democracy Counts
Free & Fair. (2018). "Open and Free Election Technology."
 Zetter, Kim (2008-12-08). "Unique Transparency Program Uncovers Problems with Voting Software". Wired. ISSN 1059-1028.
 "counties have discretion in managing the settings and implementing manufacturers' guidelines" https://www-cdn.law.stanford.edu/wp-content/uploads/2020/04/FINAL-Signature-Verification-Report-4-15-20.pdf
"Ballot Now was unable to detect at least 90 percent of each "target box"... Ballot Now (in autoresolve mode) confirmed and recorded the damaged contests as undervoted." http://www.votersunite.org/info/yakimaproblemreport.asp
 Examples of blocked or faulty scanner sensors include:
∑ Washington: Gideon, John (July 5, 2005). "Hart InterCivic Optical-Scan Has a Weak Spot". www.votersunite.org.
∑ Maryland: Walker, Natasha (February 16, 2017). "2016 Post Election Audits in Maryland" (PDF). National Institute of Standards and Technology.
∑ Maryland: Ryan, Tom and Benny White (November 30, 2016). "Transcript of Email on Ballot Images" (PDF). Pima County, Arizona..
† Using automatically created digital ballot images† to verify voting-machine output in Wisconsin, https://wisconsinelectionintegrity.org/2016/01/† and https://wisconsinelectionintegrity.org/2016/d3n8a8pro7vhmx.cloudfront.net/wiscgrassrootsnetwork/pages/1500/attachments/original/1452755405/DevelopmentReport-DigitalImageAuditsd75c.pdf?1452755405
 Reconstructed ballots are ballots created by election staff when originals cannot be counted for some reason, such as tears, water damage or folds which prevent feeding them through election machines. As many as 8% of ballots in an election may be reconstructed. White, Rebecca (2019-11-18). "One Washington County Plans to Speed Vote Counting with Tech". Government Technology
"Roughly 2,000... ballots were damaged and reconstructed... ballots have to be recreated in every election for a number of reasons, ranging from damaged mail-in ballots, to early voters who use pencils which canít be read by ballot tabulators." Jordan, Ben (2018-11-07). "MKE Election Commission responds to criticism". WTMJ TV Milwaukee.
Duplicate ballot procedures in Michigan https://www.michigan.gov/documents/sos/XII_Precinct_Canvass_-_Closing_the_Polls_266013_7.pdf
Duplicate ballot procedures in Ventura County, CA https://recorder.countyofventura.org/wp-content/uploads/2018/05/BALLOT-DUPLICATION-PROCESS-FACTS-2-Final-1.pdf
 "With the new digital procedure, staff will be able to fix whatever race couldnít be counted, instead of duplicating a voterís entire ballot." White, Rebecca (2019-11-18). "One Washington County Plans to Speed Vote Counting with Tech". Government Technology
 "perform the audit that you are able to" Vora, Poorvi (November 6, 2016). ""Exhibit B. Pages 20-23 in Lamone, Linda H. (December 22, 2016). "Joint Chairman's Report on the 2016 Post-Election Tabulation Audit" (PDF). Maryland State Board of Elections.
 When there are enough errors to switch the winner, the probability of catching at least one of those errors depends on the victory margin and the sample size. It is 1-(1-margin/2)sample size So if margin is 2%, which is 0.02, formula is 1-(1-0.02/2)500 = 1-(1-0.01)500 = 1-(0.99)500 = 1-(0.00657) = 0.99343 = 99.343%. If two or more candidates can win the same contest, like many school board members, the margin is between the lowest winner and highest loser.
 Rebecca Mercuri points out that election staff are used to ignoring small discrepancies. Normally they must, to get results done. She expects them to ignore even 10 discrepancies found by a random sample, which undermines the reliability of the sample. https://www.cnet.com/news/electronic-voting-and-partial-audits/
 Hyergeometric distribution shows the chances of finding any specific sample of items from a distinct category, like flawed scans (k flaws in sample), depending on sample size (n), total number in the distinct category (m flaws total), and total number of all items (N ballots). For example if total scans=100,000=N, and assuming total flawed scans =1,000=m=1%, and sample size=200=n, then a calculator at https://www.dcode.fr/picking-probabilities shows 13% chance of exactly 0 flawed scans (k=0). The calculator also shows 27% chance of 1 flawed scan (k=1) and another 27% chance of 2 flawed scans (k=2). These numbers leave 33% chance of 3 or more flawed scans. The sample needs to be completely random, not clustered, and then it will catch flaws whether these too are random, or are clustered in one or a few scanners. A clustered sample would have more complex formulas and much less chance of catching clustered flaws.
 RLA sample "is highly dependent on the margin of victory in any given audited contest... A very close margin of victory could... require days of staff work, possibly compromising the local certification deadline." Maryland State Board of Elections (October 21, 2016). "Post-Election Tabulation Audit Pilot Program Report"
 Lindeman et al. (January 3, 2018). "Comments re statistics of auditing the 2018 Colorado elections" (PDF). Colorado Secretary of State
 "Roughly 2,000... ballots were damaged and reconstructed... ballots have to be recreated in every election for a number of reasons, ranging from damaged mail-in ballots, to early voters who use pencils which canít be read by ballot tabulators." Jordan, Ben (2018-11-07). "MKE Election Commission responds to criticism". WTMJ TV Milwaukee.
 Cobb, Sue (2016-10-17). "The 2000 Presidential Election Ė The Florida Recount". Association for Diplomatic Studies & Training.
 Baker, Deborah (2004-10-31). "ABQjournal: Contentious 2000 Election Closest in N.M. History". Albuquerque Journal.