RailwayData @ f0af0c6e1c4542a5f37eaf55e7a321399e62f72a UserData @ 53b7be8abcb53d9e063593517e183a6b14d31fd6 DataProcessing @ 1f92c6cc4499d5f0641ad91c505747f1b5d108b8 Start: Wed Sep 6 23:22:58 2023 [0.0] Making list of travelers. [0.0] Reading region, country, and continent descriptions. [0.0] Reading systems list in /fast/home/terescoj/travelmapping/RailwayData/systems.csv.........................................................................................................................................................................................................................................................................................................................................................................................................................! [0.1] Finding all .wpt files. 3548 files found. [0.1] Reading waypoints for all routes. ausnswtl ausqrt austwa ausvln ausasr ausmtm ausqrc ausst austto aussm ausat ausbt auscm ausgclr ausnlr ausslr ausyt autsk autso autss autsst autst autsv autsw autus autuw autstgm autstg autsti autstl autstw belic bell belrsa belrsb belrsc belrsg belrsl belbm belcm belat belbt belgt belkt bgrsm bgrst canttc canstm canrem cheags chebes chebss chechs chefrrer chelx chesgs chesob chesos chetirc chevdrer chezhs chezss chelm chebet chebst cheget chezht czeduk czeem czeep czeidol czeiredo czevmjk czemp czetb czetl czetml czetol czetos czetpl czetp deubs deufrs deuhbs deudds deuhhs deuhs deukas deuls deumds deums deuns deurms deurns deuros deurrs deuss deuulrs deubu deubisb deucc deufu deuhhu deuhsb deuksrt deumu deunu deurssb deurru deusb deusu deuws deuat deubt deubrbt deubst deuhbt deuct deuctt deudat deudet deuddt deueft deuft deufft deufrt deugt deugrt deugtht deuhbst deuhalt deujt deukat deukst deult deumdt deumzt deumt deunmbt deundht deunt deuplt deurnt deurrt deurot deusnt deuswat deuult deuwut deuzt deuddb deunwh dnkks dnkkm espca espcc espcm espcma espcmu espcsa espcs espcv espcz espet espfs esprab esprad esprc esprf espsfm espbm espmb espmvbl espmm espmma espmp espms espmv espetb espmg espmlm espta esptb esptbc esptmu espts esptt esptz euret eurapm eurapma eurat eurhr fracp frahdfter franaqter frarer fratra frattu frallm fralym framam frapm frarm fratm fraant fraaut frabet frabrt frabt fracft fract fradt fragt fraidft frallt fralht fralmt fralyt framat framot framut franat franit fraot fraret frarot fraset fratot frast fratt fravt frafdm fralhf fralyf gbncs gbngc gbngr gbngx gbnht gbnhx gbnld gbnsx gbnvt gbnxc gbnaw gbncc gbnch gbnem gbngn gbngw gbnil gbnle gbnln gbnlo gbnme gbnnr gbnse gbnsn gbnsr gbnsw gbntl gbntp gbnwm gbnxr irlnir gbndlr gbngs gbnlu gbntwm gbnbt gbnet gbnlt gbnman gbnnet gbnss gbnwmm hkgmtr hkghkt hkglr hkgnpcc hkgop hkgpt hrvzt hunbm hunbt imnimr irlent irlie irlluas itafl itanf itanr itans itanv itagu itams itatfm itafc itagm itamm itanm itarm itatm itart itamt itant itatt itagf itanfc luxst nldam nldrm nldat nldht nldrt nldut nzlatm nzlkr nzlwm polksl polpkm polskam polskmb polskmt polskmw polwkd polwm polbt polct polet polgdt polgwt polgrt polkt pollt polot polpt polslt polszt poltt polwt polwrt sgpmrt sgplrt srbbt svkzdb svkedb svkedk svktez usacndx usalirr usamarc usambtx usamncw usanctc usanjtr usascax usasepa usautax usavrex usabhcr usapvhmr usavale usasrc usahvrx usabmsl usambta usapatco usasepta usanycs usapath usasir usawmat usamarta usamdt usarta usacta usalvm usalams usablrl usanfta usadcsc usalynx usambtlr usamtlr usanjlr usaseplr usapitlr usatide usartalr usadart usamtahc usavmr usautat usalamlr usamts usaairtrn usaatl usamiam usaphx usahunhts usarooist usawvuprt usammm usatsc usautasusarkcs [0.3] Sorting waypoints in Quadtree. [0.3] Finding unprocessed wpt files. 16 .wpt files in /fast/home/terescoj/travelmapping/RailwayData/data not processed, see unprocessedwpts.log. [0.3] Searching for near-miss points. [0.3] Near-miss point log and tm-master.nmp file. [0.4] Concurrent segment detection.........................................................................................................................................................................................................................................................................................................................................................................................................................! [0.4] Creating label hashes and checking route integrity. [0.5] Reading updates file. [0.5] Reading systemupdates file. [0.5] Processing traveler list files: communityrailpartnerships aznate cockroachking cl94 deathtopumpkins duke87 kurzov londonpayg markkos1992 michih oyster panda80 scenicrailbritain si404 terescoj testmta the_spui_ninja [0.5] Processed 17 traveler list files. [0.5] Clearing route & label hash tables. [0.5] Writing route and label logs. [0.5] Augmenting travelers for detected concurrent segments..................! [0.5] Writing to concurrencies.log. [0.5] Computing stats...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................! [0.5] Writing highway data stats log file (highwaydatastats.log). [0.5] Creating per-traveler stats logs and augmenting data structure..................! [0.5] Writing stats csv files. [0.5] Writing allbyregionactiveonly.csv. [0.5] Writing allbyregionactivepreview.csv. [0.5] Writing per-system stats csv files. [0.5] Reading datacheckfps.csv. [0.5] Start writing database file TravelMappingRail-2023-09-06@23:22:57.sql. [0.5] Setting up for graphs of highway data. [0.6] Creating unique names and vertices.....! [0.7] Creating edges....................................................................! [0.7] Compressing collapsed edges..ERROR: segment name mismatch in HGEdge collapse constructor: edge1 named S5Jih,S6Jih edge2 named S9Jih ...! [0.7] Writing graph waypoint simplification log. [0.7] Writing master TM graph files. Simple graph has 46205 vertices, 48442 edges. Collapsed graph has 37155 vertices, 39392 edges. Traveled graph has 37164 vertices, 39401 edges. [0.7] Setting up subgraphs. [0.7] Writing continent graphs. AFR (27,26) (27,26) (27,26) ASI (482,532) (461,511) (461,511) NA (4547,4636) (3220,3309) (3222,3311) OCE (3277,3375) (2192,2290) (2192,2290) EUR (37872,39873) (31255,33256) (31262,33263) [0.9] Writing country graphs. AUS (3135,3234) (2090,2189) (2090,2189) CAN (197,197) (147,147) (147,147) DEU (9096,9543) (8182,8629) (8188,8635) ESP (2676,2813) (2148,2285) (2148,2285) FRA (4214,4398) (3342,3526) (3342,3526) GBR (6113,6375) (4416,4678) (4417,4679) ITA (1877,2005) (1619,1747) (1619,1747) USA (4350,4439) (3073,3162) (3075,3164) [1.9] Writing region graphs. AL (4,3) (4,3) (4,3) AUS-ACT (14,13) (14,13) (14,13) AUS-NSW (873,887) (445,459) (445,459) AUS-QLD (613,614) (243,244) (243,244) AUS-SA (133,132) (127,126) (127,126) AUS-VIC (1284,1368) (1142,1226) (1142,1226) AUS-WA (220,220) (121,121) (121,121) AUT (1782,1904) (1467,1589) (1467,1589) AZ (84,84) (58,58) (58,58) BEL (1769,1927) (1418,1576) (1418,1576) BGR (202,211) (201,210) (201,210) CA (594,601) (269,276) (269,276) CHE (2089,2209) (1729,1849) (1729,1849) CT (122,120) (60,58) (60,58) CZE (3129,3256) (2481,2608) (2481,2608) DC (69,71) (63,65) (63,65) DE (10,9) (5,4) (5,4) DEU-BW (1529,1582) (1350,1403) (1351,1404) DEU-BY (914,942) (836,864) (836,864) DEU-BE (720,837) (672,789) (672,789) DEU-BB (319,308) (300,289) (300,289) DEU-HB (213,218) (196,201) (197,202) DEU-HH (176,182) (157,163) (157,163) DEU-HE (688,710) (614,636) (615,637) DEU-MV (143,147) (129,133) (129,133) DEU-NI (515,517) (439,441) (440,442) DEU-NW (1804,1934) (1623,1753) (1623,1753) DEU-RP (248,246) (209,207) (209,207) DEU-SL (47,45) (45,43) (45,43) DEU-SN (1039,1072) (929,962) (931,964) DEU-ST (497,507) (452,462) (452,462) DEU-SH (24,18) (24,18) (24,18) DEU-TH (278,278) (265,265) (265,265) DNK (148,158) (128,138) (128,138) ENG (4596,4838) (3504,3746) (3505,3747) ESP-AN (200,198) (158,156) (158,156) ESP-AR (31,30) (28,27) (28,27) ESP-AS (285,289) (218,222) (218,222) ESP-CB (120,119) (86,85) (86,85) ESP-CL (100,97) (66,63) (66,63) ESP-CM (3,2) (3,2) (3,2) ESP-CN (27,26) (27,26) (27,26) ESP-CT (619,674) (473,528) (473,528) ESP-GA (67,66) (53,52) (53,52) ESP-IB (52,52) (41,41) (41,41) ESP-MC (73,70) (59,56) (59,56) ESP-MD (432,502) (374,444) (374,444) ESP-PV (311,315) (267,271) (267,271) ESP-VC (367,373) (306,312) (306,312) FL (67,69) (47,49) (47,49) FRA-ARA (370,377) (337,344) (337,344) FRA-BFC (68,66) (68,66) (68,66) FRA-BRE (59,57) (59,57) (59,57) FRA-CVL (109,104) (95,90) (95,90) FRA-GES (182,177) (168,163) (168,163) FRA-HDF (761,787) (535,561) (535,561) FRA-IDF (1143,1277) (1009,1143) (1009,1143) FRA-NOR (131,124) (112,105) (112,105) FRA-NAQ (878,896) (478,496) (478,496) FRA-OCC (179,182) (170,173) (170,173) FRA-PDL (172,170) (170,168) (170,168) FRA-PAC (180,181) (159,160) (159,160) GA (83,82) (42,41) (42,41) GGY (3,2) (3,2) (3,2) GIB (3,2) (3,2) (3,2) HKG (299,322) (282,305) (282,305) HRV (126,133) (125,132) (125,132) HUN (374,390) (370,386) (370,386) IL (222,224) (156,158) (156,158) IMN (108,104) (96,92) (96,92) IRL (455,458) (235,238) (235,238) ITA-CAM (319,336) (273,290) (273,290) ITA-LAZ (457,471) (367,381) (367,381) ITA-LIG (103,103) (79,79) (79,79) ITA-LOM (648,726) (582,660) (582,660) ITA-PIE (347,366) (315,334) (315,334) ITA-TRE (5,3) (5,3) (5,3) LIE (5,4) (5,4) (5,4) LUX (63,62) (29,28) (29,28) MA (423,435) (281,293) (281,293) MD (202,199) (116,113) (116,113) MN (58,57) (39,38) (39,38) MO (16,15) (11,10) (11,10) NIR (112,111) (68,67) (68,67) NC (44,43) (42,41) (42,41) NJ (368,375) (254,261) (255,262) NLD (841,919) (767,845) (767,845) NV (12,11) (7,6) (7,6) NY (876,922) (758,804) (758,804) [2.8] Pause writing database file TravelMappingRail-2023-09-06@23:22:57.sql. NZL (142,141) (102,101) (102,101) OH (74,73) (53,52) (53,52) ON (92,92) (72,72) (72,72) PA (596,605) (560,569) (561,570) POL (2564,2703) (2292,2431) (2292,2431) QC (105,105) (75,75) (75,75) RI (12,11) (5,4) (5,4) SCT (891,913) (492,514) (492,514) SD (11,10) (3,2) (3,2) SGP (183,210) (179,206) (179,206) SRB (89,92) (85,88) (85,88) SVK (227,233) (195,201) (195,201) TX (164,162) (109,107) (109,107) UT (141,137) (81,77) (81,77) VA (108,108) (66,66) (66,66) WLS (522,511) (360,349) (360,349) WV (15,13) (9,7) (9,7) ! [2.9] Clearing HighwayGraph contents from memory. [2.9] Marking datacheck false positives.........! [2.9] Found 8174 datacheck errors and matched 0 FP entries. [2.9] Writing log of unmatched datacheck FP entries. [2.9] Writing datacheck.log [2.9] Resume writing database file TravelMappingRail-2023-09-06@23:22:57.sql. [3.0] Processed 408 highway systems. Processed 3532 routes with a total of 96435 points and 92903 segments. [3.0] WaypointQuadtree contains 4537 total nodes. [3.0] Computing waypoint colocation stats. Waypoint colocation counts: 24694 are each occupied by 1 waypoints. 10844 are each occupied by 2 waypoints. 4628 are each occupied by 3 waypoints. 2447 are each occupied by 4 waypoints. 1261 are each occupied by 5 waypoints. 748 are each occupied by 6 waypoints. 468 are each occupied by 7 waypoints. 314 are each occupied by 8 waypoints. 239 are each occupied by 9 waypoints. 119 are each occupied by 10 waypoints. 100 are each occupied by 11 waypoints. 81 are each occupied by 12 waypoints. 67 are each occupied by 13 waypoints. 55 are each occupied by 14 waypoints. 28 are each occupied by 15 waypoints. 19 are each occupied by 16 waypoints. 18 are each occupied by 17 waypoints. 7 are each occupied by 18 waypoints. 11 are each occupied by 19 waypoints. 8 are each occupied by 20 waypoints. 9 are each occupied by 21 waypoints. 8 are each occupied by 22 waypoints. 4 are each occupied by 23 waypoints. 9 are each occupied by 24 waypoints. 2 are each occupied by 25 waypoints. 4 are each occupied by 26 waypoints. 1 are each occupied by 27 waypoints. 2 are each occupied by 28 waypoints. 2 are each occupied by 29 waypoints. 3 are each occupied by 30 waypoints. 1 are each occupied by 31 waypoints. 1 are each occupied by 32 waypoints. 2 are each occupied by 33 waypoints. 1 are each occupied by 34 waypoints. Unique locations: 46205 Finish: Wed Sep 6 23:23:01 2023 Total run time: [3.0]