Casino data wrong

[wfaulk]

If I add all of the words spoken by all the characters in Casino together, I get 67678 words. But there are only 51645 words in the entire Casino script that you reference, including stage direction. (51831 as downloaded by your Node.js script, which includes web page menus and other unrelated stuff.)

Something is very wrong.

[wfaulk]

Turns out that script is surprisingly well formatted, so I wrote a script to parse it and find out the actual word counts. I manually edited down the downloaded script so that it was just the script and none of the extraneous stuff (starting with "EXT. RESTAURANT PARKING LOT, LAS VEGAS, 1983 - DAY" and ending with "FADE TO BLACK") and ran this perl script against it:

#!/usr/bin/perl

use strict;
use warnings;

my $char;
my $dialogue;
my %words;

while (<>) {
    if ( /^ {48}(.*)$/ ) {
	    # DISSOLVE TO
    }
    elsif ( /^ {22}(.*)$/ ) {
	    # Character
	    $char = $1;
	    $char =~ s/ \((V\.O\.|O\.S\.)\).*$//;
    }
    elsif ( /^ {10}(.*)$/ ) {
	    # Dialogue
	    $dialogue = $1;
	    my $numwords = split(" ", $1);
	    $words{$char} += $numwords;
    }
}

foreach $char (sort {$words{$b} <=> $words{$a}} (keys %words) ) {
    print "\"$char\",$words{$char}\n";
}

and got these results:

"ACE",11148
"NICKY",8030
"GINGER",3388
"LESTER",761
"MARINO",572
"PISCANO",549
"GAGGI",503
"WEBB",401
"STONE",384
"SHERBERT",373
"COP #1",260
"GREEN",226
"NEWSCASTER",197
"JENNIFER",196
"BORELLI",180
"CHARLIE CLARK",170
"SENATOR",153
"PISCANO'S MOTHER",137
"COP #2",119
"WARD",118
"FEMALE NEWSCASTER",113
"AUSTIN",104
"OSCAR",93
"NANCE",91
"TRUDY",90
"HIGH ROLLER",82
"STAGE MANAGER",81
"COWBOY",75
"DETECTIVE JOHNSON",61
"DOMINICK",60
"JOE",55
"AMY",54
"DEALER",53
"FBI AGENT #4",52
"SCOTT",49
"WINNER",47
"LAWYER",47
"BANKER",47
"FORLANO",45
"SECURITY GUARD #1",44
"FRANKIE AVALON",43
"AL",43
"CASHIER",39
"PISCANO'S WIFE",39
"SIGNALER",39
"SECRETARY",38
"FBI AGENT #1",36
"TONY",36
"FBI AGENT #10",36
"JUDGE",35
"FBI AGENT",35
"DOCTOR DAN",35
"LITTLE NICKY",35
"FBI AGENT #2",35
"EDDY",34
"JERRY",32
"SUPER SUBTITLE",32
"NICKY:",31
"DUPREY",31
"FBI AGENT #9",28
"REPORTER",27
"ROCKY",25
"REPORTER #1",25
"TONY DOGS",25
"EXECUTIVE",24
"HARDY",24
"COUNTRY-CLUB WOMAN #3",24
"MAITRE D'",24
"STEVE ALLEN",23
"MAN #1",22
"HOTEL RECEPTIONIST",22
"VALET PARKER",21
"ICHIKAWA",20
"IRANIAN #2",20
"RUDY",19
"CREDIT CLERK",19
"GAMBLER #1",18
"SECURITY GUARD #2",18
"WAITRESSES",18
"HOTEL OPERATOR",18
"CLASSROOM NUN",17
"IRANIAN #1",16
"BROTHER-IN-LAW",16
"REPORTER #2",15
"BLUE",15
"STORE OWNER",15
"AMBULANCE DRIVER",15
"FAT SALLY",14
"CAPELLI",14
"COUNT ROOM EXEC",14
"AGENT",13
"MIKE",13
"ANDY STONE",13
"PHOTOGRAPHER #1",12
"LAWYER #2",12
"GAMBLER #2",11
"LAWYER #1",11
"BELLMAN",11
"FUSCO",10
"COUNTER #1",9
"PHOTOGRAPHER #3",9
"MOOSH",9
"LIP-READER",8
"RACE ANNOUNCER",8
"FBI AGENT #5",8
"MAN #2",8
"CONTROL BOARD MEMBER #1",8
"COUNTRY-CLUB WOMAN #2",8
"BAKER",8
"PIT BOSS",8
"LUCKY LARRY",7
"CURLY",7
"REPORTER #3",6
"OPERATOR",5
"JERRY/EDDY",5
"FBI AGENT #3",5
"VALET PARKER #3",5
"DEALER #1",5
"OLD MAN CAPO",5
"COUNTRY-CLUB MAN #1",4
"HOOD #2",4
"CARD SHARK",4
"NICKY/GINGER",3
"SHIFT BOSS",3
"WOMAN",3
"CONTROL BOARD MEMBER #3",3
"HOOD #1",3
"CONTROL BOARD MEMBER #2",3
"FBI AGENT #8",3
"CONTROL BOARD MEMBER #4",3
"JAYNE MEADOWS",2
"HIGH ROLLER #2",2
"BARTENDER",2
"STACY",2
"COUNTER #2",2
"COUNTRY-CLUB WOMAN #1",2
"BLONDE",2
"PHOTOGRAPHER #2",2
"FBI AGENT #6",1
"SHELLY",1
"COOK",1