RailwayData @ d10eeefa4fc5c0f70828f98a855fc2b401a8297d UserData @ c2581f60ded2d9df471d355e0af562afc704f830 DataProcessing @ 03a36cab6f56c4f060bc41ce4739707a03969a15 Start: Sun Dec 17 21:36:06 2023 [0.0] Making list of travelers. [0.0] Reading region, country, and continent descriptions. [0.0] Reading systems list in /fast/home/terescoj/travelmapping/RailwayData/systems.csv.............................................................................................................................................................................................................................................................................................................................................................................................................................................................! [0.1] Finding all .wpt files. 3913 files found. [0.1] Reading waypoints for all routes. ausqrt ausnswtl austwa ausvln ausasr ausmtm ausqrc ausst austto aussm ausat ausbt auscm ausgclr ausnlr ausslr ausyt autsk autso autss autsst autst autsv autsw autus autuw autstgm autstg autsti autstl autstw belic bell belrsa belrsb belrsc belrsg belrsl belbm belcm belat belbt belgt belkt bgrsm bgrst canttc canstm canrem cheags chebes chebss chechs chefrrer chelx chesgs chesob chesos chetirc chevdrer chezhs chezss chelm chebet chebst cheget chezht czeduk czedukt czeem czeep czeidol czeiredo czevmjk czemp czetb czetl czetml czetol czetos czetpl czetp deubs deufrs deuhbs deudds deuhhs deuhs deukas deuls deumds deums deuns deurms deurns deuros deurrs deuss deuulrs deubu deubisb deucc deufu deuhhu deuhsb deuksrt deumu deunu deurssb deurru deusb deusu deuws deuat deubt deubrbt deubst deuhbt deuct deuctt deudat deudet deuddt deueft deuft deufft deufrt deugt deugrt deugtht deuhbst deuhalt deujt deukat deukst deult deumdt deumzt deumt deunmbt deundht deunt deuplt deurnt deurrt deurot deusnt deuswat deuult deuwut deuzt deuddb deunwh dnkks dnkkm espca espcc espcm espcma espcmu espcsa espcs espcv espcz espet espfs esprab esprad esprc esprf espsfm espbm espmb espmvbl espmm espmma espmp espms espmv espetb espmg espmlm espta esptb esptbc esptmu espts esptt esptv esptz eures euret eurapm eurf eurhr fracp frahdfterk frahdfterc frahdfterp franaqterd franaqterf franaqterl frarer fratra frattu frallm fralym framam frapm frarm fratm fraant fraaut frabet frabrt frabt fracft fract fradt fragt fraidft frallt fralht fralmt fralyt framat framot framut franat franit fraot fraret frarot fraset frast fratot fratt fravt gbncs gbngc gbngr gbngx gbnht gbnhx gbnld gbnsx gbnvt gbnxc gbnaw gbncc gbnch gbnem gbngn gbngw gbnle gbnln gbnlo gbnme gbnnr gbnse gbnsn gbnsr gbnsw gbntl gbntp gbnwm gbnxr irlnir gbndlr gbngs gbnlu gbntwm gbnbt gbnet gbnlt gbnman gbnnet gbnss gbnwmm hkgmtr hkghkt hkglr hkgop hkgpt hrvzt hunbm hunbt imnimr irlent irlie irlluas itafl itanf itanr itans itanv itagu itams itatfm itafc itagm itamm itanm itarm itatm itart itamt itant itatt jpnsks jpnjrs jpniyo jpntke jpn3tos jpnmono jpntmmy jpn3asa luxcfl luxst nldic nldre nldrs nldam nldrm nldat nldht nldrt nldut norf norft norre norr norl norot norbb norto nzlatm nzlkr nzlwm polksl polpkm polskam polskmb polskmt polskmw polwkd polwm polbt polct polet polgdt polgwt polgrt polkt pollt polot polpt polslt polszt poltt polwt polwrt roubm roubt sgpmrt sgplrt srbbt svkzdb svkedb svkedk svktez swesj swesl swest swess turib turim turit turif usacndx usalirr usamarc usambtx usametx usamncw usanctc usanjtr usanmrx usartdx usascax usasepa usautax usavrex usatr usaace usajpbx usasmart usabmsl usambta usapatco usasepta usanycs usapath usasir usawmat usamarta usamdt usarta usacta usalvm usalams usabart usablrl usanfta usadcsc usalynx usambtlr usamtlr usanjlr usaseplr usapitlr usatide usartalr usadart usamtahc usavmr usautat usalamlr usamts usartdz usamuni usasrt usavta usaair usair usahunhts usarooist usawvuprt usammm usatsc usautas usakcsc usalvct usasfcc [0.3] Sorting waypoints in Quadtree. [0.3] Finding unprocessed wpt files. 58 .wpt files in /fast/home/terescoj/travelmapping/RailwayData/data not processed, see unprocessedwpts.log. [0.3] Searching for near-miss points. [0.4] Near-miss point log and tm-master.nmp file. [0.4] Concurrent segment detection.............................................................................................................................................................................................................................................................................................................................................................................................................................................................! [0.5] Creating label hashes and checking route integrity. [0.5] Reading updates file. [0.5] Reading systemupdates file. [0.5] Processing traveler list files: bartpetat bubaclex cl94 aznate cockroachking communityrailpartnerships deathtopumpkins duke87 ecoDuck7 imgoph kurzov londonpayg markkos1992 michih oyster panda80 scenicrailbritain si404 ssoworld terescoj testmta the_spui_ninja [0.5] Processed 22 traveler list files. [0.5] Clearing route & label hash tables. [0.5] Writing route and label logs. [0.5] Augmenting travelers for detected concurrent segments.......................! [0.5] Writing to concurrencies.log. [0.5] Computing stats...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................! [0.5] Writing routedatastats.log. [0.5] Creating per-traveler stats logs and augmenting data structure.......................! [0.6] Writing stats csv files. [0.6] Writing allbyregionactiveonly.csv. [0.6] Writing allbyregionactivepreview.csv. [0.6] Writing per-system stats csv files. [0.6] Reading datacheckfps.csv. [0.6] Start writing database file TravelMappingRail-2023-12-17@21:36:05.sql. [0.6] Setting up for graphs of highway data. [0.6] Creating unique names and vertices......! [0.7] Creating edges..........................................................................! [0.8] Compressing collapsed edges......! [0.8] Writing graph waypoint simplification log. [0.8] Writing master TM graph files. Simple graph has 50694 vertices, 52841 edges. Collapsed graph has 40375 vertices, 42522 edges. Traveled graph has 40405 vertices, 42552 edges. [0.8] Setting up subgraphs. [0.8] Writing continent graphs. AFR (27,26) (27,26) (27,26) ASI (1736,1774) (1387,1425) (1387,1425) NA (5935,5990) (4084,4139) (4086,4141) EUR (39719,41676) (32685,34642) (32713,34670) OCE (3277,3375) (2192,2290) (2192,2290) [1.1] Writing country graphs. AUS (3135,3234) (2090,2189) (2090,2189) CAN (197,197) (147,147) (147,147) DEU (9045,9371) (8235,8561) (8262,8588) ESP (2736,2863) (2197,2324) (2197,2324) FRA (4239,4427) (3350,3538) (3350,3538) GBR (6122,6381) (4431,4690) (4432,4691) ITA (1876,2004) (1618,1746) (1618,1746) USA (5738,5793) (3937,3992) (3939,3994) [1.8] Writing region graphs. AL (4,3) (4,3) (4,3) AUS-ACT (14,13) (14,13) (14,13) AUS-NSW (873,887) (445,459) (445,459) AUS-QLD (613,614) (243,244) (243,244) AUS-SA (133,132) (127,126) (127,126) AUS-VIC (1284,1368) (1142,1226) (1142,1226) AUS-WA (220,220) (121,121) (121,121) AUT (1782,1904) (1467,1589) (1467,1589) AZ (84,84) (58,58) (58,58) BEL (1780,1934) (1420,1574) (1420,1574) BGR (203,212) (202,211) (202,211) CA (1195,1192) (706,703) (706,703) CHE (2089,2209) (1729,1849) (1729,1849) CO (249,236) (125,112) (125,112) CT (122,120) (60,58) (60,58) CZE (3138,3296) (2479,2637) (2479,2637) DC (69,71) (63,65) (63,65) DE (10,9) (5,4) (5,4) DEU-BB (315,299) (299,283) (299,283) DEU-BE (739,807) (718,786) (718,786) DEU-BW (1509,1548) (1350,1389) (1354,1393) DEU-BY (912,941) (833,862) (835,864) DEU-HB (213,218) (196,201) (197,202) DEU-HE (677,696) (612,631) (614,633) DEU-HH (176,182) (157,163) (157,163) DEU-MV (143,147) (129,133) (129,133) DEU-NI (511,511) (439,439) (440,440) DEU-NW (1816,1896) (1647,1727) (1654,1734) DEU-RP (238,235) (208,205) (210,207) DEU-SH (24,18) (24,18) (24,18) DEU-SL (47,45) (45,43) (45,43) DEU-SN (1022,1056) (921,955) (925,959) DEU-ST (486,496) (452,462) (456,466) DEU-TH (276,276) (264,264) (264,264) DNK (148,158) (128,138) (128,138) ENG (4602,4843) (3515,3756) (3516,3757) ESP-AN (201,199) (159,157) (159,157) ESP-AR (33,32) (30,29) (30,29) ESP-AS (285,289) (218,222) (218,222) ESP-CB (127,126) (87,86) (87,86) ESP-CL (100,97) (66,63) (66,63) ESP-CM (6,4) (5,3) (5,3) ESP-CN (27,26) (27,26) (27,26) ESP-CT (639,691) (488,540) (488,540) ESP-GA (67,66) (53,52) (53,52) ESP-IB (64,64) (53,53) (53,53) ESP-MC (73,70) (59,56) (59,56) ESP-MD (434,501) (377,444) (377,444) ESP-PV (320,323) (276,279) (276,279) ESP-VC (373,375) (312,314) (312,314) FL (75,75) (52,52) (52,52) FRA-ARA (368,376) (335,343) (335,343) FRA-BFC (68,66) (68,66) (68,66) FRA-BRE (57,56) (57,56) (57,56) FRA-CVL (109,104) (95,90) (95,90) FRA-GES (186,179) (172,165) (172,165) FRA-HDF (780,808) (542,570) (542,570) FRA-IDF (1148,1285) (1009,1146) (1009,1146) FRA-NAQ (882,898) (482,498) (482,498) FRA-NOR (131,124) (112,105) (112,105) FRA-OCC (177,180) (168,171) (168,171) FRA-PAC (180,181) (159,160) (159,160) FRA-PDL (172,170) (170,168) (170,168) GA (83,82) (42,41) (42,41) GGY (3,2) (3,2) (3,2) HKG (295,320) (278,303) (278,303) HRV (126,133) (125,132) (125,132) HUN (374,390) (370,386) (370,386) IL (609,612) (408,411) (408,411) IMN (108,104) (96,92) (96,92) IRL (453,457) (233,237) (233,237) ITA-CAM (318,335) (272,289) (272,289) ITA-LAZ (457,471) (367,381) (367,381) ITA-LIG (103,103) (79,79) (79,79) ITA-LOM (648,726) (582,660) (582,660) ITA-PIE (347,366) (315,334) (315,334) ITA-TRE (5,3) (5,3) (5,3) JPN (953,940) (639,626) (639,626) LIE (5,4) (5,4) (5,4) LUX (124,124) (94,94) (94,94) MA (423,435) (281,293) (281,293) MD (202,199) (116,113) (116,113) MN (60,58) (41,39) (41,39) MO (15,15) (11,11) (11,11) MT (15,13) (4,2) (4,2) NC (44,43) (42,41) (42,41) NIR (112,111) (68,67) (68,67) NJ (368,373) (254,259) (255,260) NM (71,64) (30,23) (30,23) NLD (1073,1149) (934,1010) (934,1010) NOR (884,902) (478,496) (478,496) NV (68,63) (19,14) (19,14) NY (874,916) (758,800) (758,800) NZL (142,141) (102,101) (102,101) OH (74,73) (53,52) (53,52) ON (92,92) (72,72) (72,72) PA (596,605) (560,569) (561,570) POL (2526,2663) (2293,2430) (2293,2430) QC (105,105) (75,75) (75,75) RI (12,11) (5,4) (5,4) ROU (340,367) (331,358) (331,358) SCT (891,913) (493,515) (493,515) SD (11,10) (3,2) (3,2) SGP (183,210) (179,206) (179,206) SRB (89,92) (85,88) (85,88) SVK (227,233) (195,201) (195,201) SWE (313,323) (271,281) (271,281) TN (2,1) (2,1) (2,1) TUR (305,304) (291,290) (291,290) TX (169,166) (114,111) (114,111) UT (145,141) (81,77) (81,77) VA (108,108) (66,66) (66,66) WI (3,2) (2,1) (2,1) WLS (528,514) (366,352) (366,352) WV (15,13) (9,7) (9,7) [3.0] Pause writing database file TravelMappingRail-2023-12-17@21:36:05.sql. ! [3.0] Clearing HighwayGraph contents from memory. [3.0] Marking datacheck false positives.........! [3.1] Found 8597 datacheck errors and matched 0 FP entries. [3.1] Writing log of unmatched datacheck FP entries. [3.1] Writing datacheck.log [3.1] Resume writing database file TravelMappingRail-2023-12-17@21:36:05.sql. [3.1] Processed 444 highway systems. Processed 3855 routes with a total of 103612 points and 99757 segments. [3.1] WaypointQuadtree contains 4989 total nodes. [3.1] Computing waypoint colocation stats. Waypoint colocation counts: 27819 are each occupied by 1 waypoints. 11658 are each occupied by 2 waypoints. 4863 are each occupied by 3 waypoints. 2670 are each occupied by 4 waypoints. 1288 are each occupied by 5 waypoints. 760 are each occupied by 6 waypoints. 485 are each occupied by 7 waypoints. 330 are each occupied by 8 waypoints. 219 are each occupied by 9 waypoints. 130 are each occupied by 10 waypoints. 115 are each occupied by 11 waypoints. 91 are each occupied by 12 waypoints. 63 are each occupied by 13 waypoints. 52 are each occupied by 14 waypoints. 30 are each occupied by 15 waypoints. 22 are each occupied by 16 waypoints. 21 are each occupied by 17 waypoints. 5 are each occupied by 18 waypoints. 8 are each occupied by 19 waypoints. 10 are each occupied by 20 waypoints. 7 are each occupied by 21 waypoints. 9 are each occupied by 22 waypoints. 6 are each occupied by 23 waypoints. 11 are each occupied by 24 waypoints. 4 are each occupied by 25 waypoints. 2 are each occupied by 26 waypoints. 1 are each occupied by 27 waypoints. 1 are each occupied by 28 waypoints. 2 are each occupied by 29 waypoints. 5 are each occupied by 30 waypoints. 1 are each occupied by 31 waypoints. 2 are each occupied by 32 waypoints. 1 are each occupied by 33 waypoints. 1 are each occupied by 34 waypoints. 0 are each occupied by 35 waypoints. 1 are each occupied by 36 waypoints. 1 are each occupied by 37 waypoints. Unique locations: 50694 Finish: Sun Dec 17 21:36:09 2023 Total run time: [3.1]