/home/linuxbuildslave/buildslaves/ailinux/ipc-prob-build-singularity-linux/build/tmp6I7fsS /home/linuxbuildslave/buildslaves/ailinux/ipc-prob-build-singularity-linux/build/tmp6I7fsS *************** RDDL-PARSER CALL WITH 600SEC *************** Parsing... Setting outcome pruning to 0.1 ...finished (0.00104499s). instantiating... Instantiating variables... ...finished (7.86781e-06) Instantiating CPFs... ...finished (4.60148e-05) Instantiating preconditions... ...finished (5.00679e-06) ...finished (7.10487e-05s). preprocessing... Preparing evaluatables... ...finished (4.00543e-05) Preparing actions... ...finished (1.81198e-05) Calculating CPF domain... ...finished (2.00272e-05) Finalizing evaluatables... ...finished (2.69413e-05) Computing determinization... ...finished (2.88486e-05) Preparing hash keys... ...finished (1.09673e-05) Precomputing evaluatables... ...finished (0.000170946) ...finished (0.000337839s). analyzing task... Creating training set with 215 candidates. ...finished (0.015322s). writing output for instance dice_game_demo_inst_ssp__1... ...finished (0.00202513s). writing transition relations to json file... ...finished (0.000298977s). total time: 0.0191429s RDDL-Parser took: 0.0270035s learning... THTS: learning... DD_Heuristic: learning [31s (0.125%)] with /home/linuxbuildslave/buildslaves/ailinux/ipc-prob-build-singularity-linux/build/tmp6I7fsS/dice_game_demo_inst_ssp__1.json... Horizon: 65 Round to dezimal: 2 { "actions": { "noop": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==s0])) * (1 * ([s1_primed==s1])) * (1 * ([s2_primed==s2])))" }, "roll(d1) ": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==0] * (1) + [s0_primed==1] * (1) + [s0_primed==2] * (1) + [s0_primed==3] * (1) + [s0_primed==4] * (1) + [s0_primed==5] * (1))) * (1 * ([s1_primed==s1])) * (1 * ([s2_primed==s2])))" }, "roll(d2) ": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==s0])) * (1 * ([s1_primed==0] * (1) + [s1_primed==1] * (1) + [s1_primed==2] * (1) + [s1_primed==3] * (1) + [s1_primed==4] * (1) + [s1_primed==5] * (1))) * (1 * ([s2_primed==s2])))" }, "roll(d3) ": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==s0])) * (1 * ([s1_primed==s1])) * (1 * ([s2_primed==0] * (1) + [s2_primed==1] * (1) + [s2_primed==2] * (1) + [s2_primed==3] * (1) + [s2_primed==4] * (1) + [s2_primed==5] * (1))))" } }, "goal_state": "[[s0 == 5] && [s1 == 5] && [s2 == 5]]", "initial_state": { "s0": 0, "s1": 0, "s2": 0 }, "variables": { "s0": { "domain": 6 }, "s1": { "domain": 6 }, "s2": { "domain": 6 } } } Original ordering: s0 s1 s2 Build ast.....done! Compute fan-in...done! Fan-in ordering: s0 s1 s2 [s0 : 0] [s1 : 1] [s2 : 2] Num variables: 3 => 9 [ incl. primed: 18 ] noop......overall time: 0.04 => Time left: 31.21s roll(d1) ......overall time: 0.06 => Time left: 31.19s roll(d2) ......overall time: 0.07 => Time left: 31.18s roll(d3) ......overall time: 0.09 => Time left: 31.16s Plan step 1... ...overall time: 0.09 => Time left: 31.16s Plan step 2... ...overall time: 0.09 => Time left: 31.16s Plan step 3... ...overall time: 0.09 => Time left: 31.16s Plan step 4... ...overall time: 0.09 => Time left: 31.16s Plan step 5... ...overall time: 0.09 => Time left: 31.16s Plan step 6... ...overall time: 0.09 => Time left: 31.16s Plan step 7... ...overall time: 0.09 => Time left: 31.16s Plan step 8... ...overall time: 0.09 => Time left: 31.16s Plan step 9... ...overall time: 0.09 => Time left: 31.16s Plan step 10... ...overall time: 0.09 => Time left: 31.16s Plan step 11... ...overall time: 0.09 => Time left: 31.16s Plan step 12... ...overall time: 0.09 => Time left: 31.16s Plan step 13... ...overall time: 0.09 => Time left: 31.16s Plan step 14... ...overall time: 0.09 => Time left: 31.16s Plan step 15... ...overall time: 0.09 => Time left: 31.16s Plan step 16... ...overall time: 0.09 => Time left: 31.16s Plan step 17... ...overall time: 0.09 => Time left: 31.16s Plan step 18... ...overall time: 0.09 => Time left: 31.16s Plan step 19... ...overall time: 0.09 => Time left: 31.16s Plan step 20... ...overall time: 0.09 => Time left: 31.16s Plan step 21... ...overall time: 0.09 => Time left: 31.16s Plan step 22... ...overall time: 0.09 => Time left: 31.16s Plan step 23... ...overall time: 0.09 => Time left: 31.16s Plan step 24... ...overall time: 0.09 => Time left: 31.16s Plan step 25... ...overall time: 0.09 => Time left: 31.16s Plan step 26... ...overall time: 0.09 => Time left: 31.16s Plan step 27... ...overall time: 0.09 => Time left: 31.16s State space explored!!! IDS: learning... IDS: Search Depth 2: 0.000116326 / 215 = 5.41051e-07 IDS: Search Depth 3: 0.000362452 / 215 = 1.68582e-06 IDS: Search Depth 4: 0.000600249 / 215 = 2.79186e-06 IDS: Search Depth 5: 0.000850031 / 215 = 3.95363e-06 IDS: Search Depth 6: 0.00108793 / 215 = 5.06015e-06 IDS: Search Depth 7: 0.00134492 / 215 = 6.25543e-06 IDS: Search Depth 8: 0.00158252 / 215 = 7.36056e-06 IDS: Search Depth 9: 0.00184486 / 215 = 8.58075e-06 IDS: Search Depth 10: 0.00210912 / 215 = 9.80985e-06 IDS: Search Depth 11: 0.00234749 / 215 = 1.09186e-05 IDS: Search Depth 12: 0.00259289 / 215 = 1.20599e-05 IDS: Search Depth 13: 0.00284054 / 215 = 1.32118e-05 IDS: Search Depth 14: 0.00308665 / 215 = 1.43565e-05 IDS: Search Depth 15: 0.00332513 / 215 = 1.54657e-05 IDS: Search Depth 16: 0.00356281 / 215 = 1.65712e-05 IDS: Search Depth 17: 0.00381266 / 215 = 1.77333e-05 IDS: Search Depth 18: 0.00404647 / 215 = 1.88208e-05 IDS: Search Depth 19: 0.0042929 / 215 = 1.9967e-05 IDS: Search Depth 20: 0.00454266 / 215 = 2.11287e-05 IDS: Search Depth 21: 0.00478974 / 215 = 2.22779e-05 IDS: Search Depth 22: 0.00503223 / 215 = 2.34057e-05 IDS: Search Depth 23: 0.00530779 / 215 = 2.46874e-05 IDS: Search Depth 24: 0.00554178 / 215 = 2.57757e-05 IDS: Search Depth 25: 0.00579613 / 215 = 2.69587e-05 IDS: Search Depth 26: 0.00603347 / 215 = 2.80626e-05 IDS: Search Depth 27: 0.00628105 / 215 = 2.92142e-05 IDS: Search Depth 28: 0.006516 / 215 = 3.0307e-05 IDS: Search Depth 29: 0.00676266 / 215 = 3.14542e-05 IDS: Search Depth 30: 0.00700282 / 215 = 3.25712e-05 IDS: Search Depth 31: 0.00724733 / 215 = 3.37085e-05 IDS: Search Depth 32: 0.00747986 / 215 = 3.479e-05 IDS: Search Depth 33: 0.00773921 / 215 = 3.59963e-05 IDS: Search Depth 34: 0.00798588 / 215 = 3.71436e-05 IDS: Search Depth 35: 0.0082456 / 215 = 3.83516e-05 IDS: Search Depth 36: 0.00848701 / 215 = 3.94745e-05 IDS: Search Depth 37: 0.00875629 / 215 = 4.07269e-05 IDS: Search Depth 38: 0.00900075 / 215 = 4.1864e-05 IDS: Search Depth 39: 0.00923833 / 215 = 4.2969e-05 IDS: Search Depth 40: 0.0094786 / 215 = 4.40865e-05 IDS: Search Depth 41: 0.00971801 / 215 = 4.52001e-05 IDS: Search Depth 42: 0.00996871 / 215 = 4.63661e-05 IDS: Search Depth 43: 0.0101997 / 215 = 4.74404e-05 IDS: Search Depth 44: 0.0104431 / 215 = 4.85726e-05 IDS: Search Depth 45: 0.0106742 / 215 = 4.96473e-05 IDS: Search Depth 46: 0.0109091 / 215 = 5.07398e-05 IDS: Search Depth 47: 0.0111606 / 215 = 5.19096e-05 IDS: Search Depth 48: 0.0114178 / 215 = 5.3106e-05 IDS: Search Depth 49: 0.0116725 / 215 = 5.42907e-05 IDS: Search Depth 50: 0.0119053 / 215 = 5.53734e-05 IDS: Search Depth 51: 0.0121509 / 215 = 5.65159e-05 IDS: Search Depth 52: 0.0123857 / 215 = 5.76079e-05 IDS: Search Depth 53: 0.0126398 / 215 = 5.87898e-05 IDS: Search Depth 54: 0.0128914 / 215 = 5.99602e-05 IDS: Search Depth 55: 0.0131337 / 215 = 6.10868e-05 IDS: Search Depth 56: 0.0133994 / 215 = 6.23226e-05 IDS: Search Depth 57: 0.0136341 / 215 = 6.34143e-05 IDS: Search Depth 58: 0.0138793 / 215 = 6.45551e-05 IDS: Search Depth 59: 0.014111 / 215 = 6.56326e-05 IDS: Search Depth 60: 0.0143564 / 215 = 6.67738e-05 IDS: Search Depth 61: 0.0145943 / 215 = 6.78804e-05 IDS: Search Depth 62: 0.0148393 / 215 = 6.90199e-05 IDS: Search Depth 63: 0.0150736 / 215 = 7.011e-05 IDS: Search Depth 64: 0.0153064 / 215 = 7.11924e-05 IDS: Search Depth 65: 0.0155429 / 215 = 7.22924e-05 IDS: Setting max search depth to 65! IDS: ...finished Reset Det Task. ... finished THTS: ...finished ...finished (0.287547s). Final task: ----------------Actions--------------- Action fluents: roll(d1) roll(d2) roll(d3) --------------- Legal Action Combinations: noop() : Index : 0 Relevant preconditions: --------------- roll(d3) : Index : 1 Relevant preconditions: --------------- roll(d2) : Index : 2 Relevant preconditions: --------------- roll(d1) : Index : 3 Relevant preconditions: --------------- -----------------CPFs----------------- die-value(d1) HashIndex: 0, probabilistic, caching in vectors, Kleene caching in vectors of size 126. Action Hash Key Map: roll(d1) : 1 Formula: case roll(d1) then Discrete( [0 : 0.166666666666667] [1 : 0.166666666666667] [2 : 0.166666666666667] [3 : 0.166666666666667] [4 : 0.166666666666667] [5 : 0.166666666666667] ) case 1 then die-value(d1) Determinized formula: case roll(d1) then 0 case 1 then die-value(d1) Domain: @1 @2 @3 @4 @5 @6 HashKeyBase: 0: 0, 1: 1, 2: 2, 3: 3, 4: 4, 5: 5 KleeneHashKeyBase: 1 -------------- die-value(d2) HashIndex: 1, probabilistic, caching in vectors, Kleene caching in vectors of size 126. Action Hash Key Map: roll(d2) : 1 Formula: case roll(d2) then Discrete( [0 : 0.166666666666667] [1 : 0.166666666666667] [2 : 0.166666666666667] [3 : 0.166666666666667] [4 : 0.166666666666667] [5 : 0.166666666666667] ) case 1 then die-value(d2) Determinized formula: case roll(d2) then 0 case 1 then die-value(d2) Domain: @1 @2 @3 @4 @5 @6 HashKeyBase: 0: 0, 1: 6, 2: 12, 3: 18, 4: 24, 5: 30 KleeneHashKeyBase: 63 -------------- die-value(d3) HashIndex: 2, probabilistic, caching in vectors, Kleene caching in vectors of size 126. Action Hash Key Map: roll(d3) : 1 Formula: case roll(d3) then Discrete( [0 : 0.166666666666667] [1 : 0.166666666666667] [2 : 0.166666666666667] [3 : 0.166666666666667] [4 : 0.166666666666667] [5 : 0.166666666666667] ) case 1 then die-value(d3) Determinized formula: case roll(d3) then 0 case 1 then die-value(d3) Domain: @1 @2 @3 @4 @5 @6 HashKeyBase: 0: 0, 1: 36, 2: 72, 3: 108, 4: 144, 5: 180 KleeneHashKeyBase: 3969 -------------- Reward CPF: Reward HashIndex: 3, deterministic, caching in vectors, Kleene caching in maps. Action Hash Key Map: Formula: (+ (- (+ (== die-value(d1) 0) (* (== die-value(d1) 1) 2) (* (== die-value(d1) 2) 3) (* (== die-value(d1) 3) 4) (* (== die-value(d1) 4) 5) (* (== die-value(d1) 5) 6) ) 6) (- (+ (== die-value(d2) 0) (* (== die-value(d2) 1) 2) (* (== die-value(d2) 2) 3) (* (== die-value(d2) 3) 4) (* (== die-value(d2) 4) 5) (* (== die-value(d2) 5) 6) ) 6) (- (+ (== die-value(d3) 0) (* (== die-value(d3) 1) 2) (* (== die-value(d3) 2) 3) (* (== die-value(d3) 3) 4) (* (== die-value(d3) 4) 5) (* (== die-value(d3) 5) 6) ) 6) ) Is action independent: 1 ------State Fluent Hash Key Map------- a change of probabilistic state fluent 0 influences variables 0 (2) 3 (1) 4 (1) a change of probabilistic state fluent 1 influences variables 1 (2) 3 (6) 4 (6) a change of probabilistic state fluent 2 influences variables 2 (2) 3 (36) 4 (36) a change of variable 0 influences variables in Kleene states 0 (2) 3 (1) 4 (1) a change of variable 1 influences variables in Kleene states 1 (2) 3 (63) 4 (63) a change of variable 2 influences variables in Kleene states 2 (2) 3 (3969) 4 (3969) ---------Action Preconditions--------- ----------Initial State--------------- die-value(d1): 0 die-value(d2): 0 die-value(d3): 0 Remaining Steps: 2147483647 StateHashKey: 0 Hashing of States is possible. Hashing of KleeneStates is possible. This task contains unreasonable actions only in the determinization. *********************************************** >>> STARTING ROUND 1 -- REMAINING TIME 249s *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.379432s. THTS: Maximal search depth set to 65 Search time: 0.379436s Statistics of THTS: Performed trials: 111705 Created SearchNodes: 556066 Cache Hits: 611 Action Selection: Exploitation in Root: 58466 Exploration in Root: 53239 Percentage Exploration in Root: 0.476604 Skipped backups: 1266122081 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.6181 (in 111709 real visits) Q-Value Estimates: noop() : -68.4167 (in 742 real visits) roll(d3) : -61.6189 (in 36968 real visits) roll(d2) : -61.6196 (in 36916 real visits) roll(d1) : -61.6181 (in 37083 real visits) Used RAM: 282600 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.379431s. THTS: Maximal search depth set to 65 Search time: 0.379435s Statistics of THTS: Performed trials: 105871 Created SearchNodes: 527140 Cache Hits: 555 Action Selection: Exploitation in Root: 51204 Exploration in Root: 54667 Percentage Exploration in Root: 0.516355 Skipped backups: 1266614487 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.5722 (in 105875 real visits) Q-Value Estimates: noop() : -68.6722 (in 712 real visits) roll(d3) : -61.5722 (in 35586 real visits) roll(d2) : -61.5731 (in 35324 real visits) roll(d1) : -61.5937 (in 34253 real visits) Used RAM: 282600 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 0 0 2 | horizon: 65 Setting time for this decision to 0.379431s. THTS: Maximal search depth set to 65 Search time: 0.379434s Statistics of THTS: Performed trials: 103572 Created SearchNodes: 515653 Cache Hits: 552 Action Selection: Exploitation in Root: 56945 Exploration in Root: 46627 Percentage Exploration in Root: 0.450189 Skipped backups: 1267103965 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -54.9128 (in 103576 real visits) Q-Value Estimates: noop() : -60.0556 (in 986 real visits) roll(d3) : -56.5725 (in 5610 real visits) roll(d2) : -54.9273 (in 47821 real visits) roll(d1) : -54.9128 (in 49159 real visits) Used RAM: 282600 Submitted action: roll(d1) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 0 2 | horizon: 65 Setting time for this decision to 0.37943s. THTS: Maximal search depth set to 65 Search time: 0.379433s Statistics of THTS: Performed trials: 98524 Created SearchNodes: 482633 Cache Hits: 2496 Action Selection: Exploitation in Root: 83665 Exploration in Root: 14859 Percentage Exploration in Root: 0.150816 Skipped backups: 1267582041 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -32.1539 (in 98528 real visits) Q-Value Estimates: noop() : -35.2363 (in 1674 real visits) roll(d3) : -32.8046 (in 11514 real visits) roll(d2) : -32.1539 (in 83666 real visits) roll(d1) : -44.5081 (in 1674 real visits) Used RAM: 282600 Submitted action: roll(d2) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 1 2 | horizon: 65 Setting time for this decision to 0.379429s. THTS: Maximal search depth set to 65 Search time: 0.379432s Statistics of THTS: Performed trials: 100321 Created SearchNodes: 491478 Cache Hits: 2533 Action Selection: Exploitation in Root: 72623 Exploration in Root: 27698 Percentage Exploration in Root: 0.276094 Skipped backups: 1268056499 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -31.058 (in 100325 real visits) Q-Value Estimates: noop() : -33.1217 (in 1872 real visits) roll(d3) : -31.338 (in 24380 real visits) roll(d2) : -31.058 (in 72620 real visits) roll(d1) : -41.8086 (in 1453 real visits) Used RAM: 282600 Submitted action: roll(d2) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 1 2 | horizon: 65 Setting time for this decision to 0.379428s. THTS: Maximal search depth set to 65 Search time: 0.37943s Statistics of THTS: Performed trials: 98726 Created SearchNodes: 483747 Cache Hits: 2472 Action Selection: Exploitation in Root: 71464 Exploration in Root: 27262 Percentage Exploration in Root: 0.276138 Skipped backups: 1268522445 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -31.0205 (in 98730 real visits) Q-Value Estimates: noop() : -33.0745 (in 1865 real visits) roll(d3) : -31.3053 (in 23973 real visits) roll(d2) : -31.0205 (in 71462 real visits) roll(d1) : -41.8537 (in 1430 real visits) Used RAM: 282600 Submitted action: roll(d2) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 5 2 | horizon: 65 Setting time for this decision to 0.379427s. THTS: Maximal search depth set to 65 Search time: 0.37943s Statistics of THTS: Performed trials: 93412 Created SearchNodes: 446709 Cache Hits: 5087 Action Selection: Exploitation in Root: 88127 Exploration in Root: 5285 Percentage Exploration in Root: 0.0565773 Skipped backups: 1269012131 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.0515 (in 93416 real visits) Q-Value Estimates: noop() : -15.0626 (in 1763 real visits) roll(d3) : -14.0515 (in 88127 real visits) roll(d2) : -22.8552 (in 1763 real visits) roll(d1) : -22.8238 (in 1763 real visits) Used RAM: 282600 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 5 3 | horizon: 65 Setting time for this decision to 0.379426s. THTS: Maximal search depth set to 65 Search time: 0.37943s Statistics of THTS: Performed trials: 94035 Created SearchNodes: 449872 Cache Hits: 5077 Action Selection: Exploitation in Root: 85855 Exploration in Root: 8180 Percentage Exploration in Root: 0.0869889 Skipped backups: 1269505095 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.0668 (in 94039 real visits) Q-Value Estimates: noop() : -13.5584 (in 4779 real visits) roll(d3) : -13.0668 (in 85826 real visits) roll(d2) : -19.7892 (in 1717 real visits) roll(d1) : -19.5867 (in 1717 real visits) Used RAM: 282600 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 5 0 | horizon: 65 Setting time for this decision to 0.379425s. THTS: Maximal search depth set to 65 Search time: 0.379429s Statistics of THTS: Performed trials: 93695 Created SearchNodes: 448132 Cache Hits: 5087 Action Selection: Exploitation in Root: 88394 Exploration in Root: 5301 Percentage Exploration in Root: 0.0565772 Skipped backups: 1269999603 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.0691 (in 93699 real visits) Q-Value Estimates: noop() : -19.1946 (in 1768 real visits) roll(d3) : -16.0691 (in 88395 real visits) roll(d2) : -27.7008 (in 1768 real visits) roll(d1) : -27.5312 (in 1768 real visits) Used RAM: 282600 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 5 0 | horizon: 65 Setting time for this decision to 0.379424s. THTS: Maximal search depth set to 65 Search time: 0.379429s Statistics of THTS: Performed trials: 92973 Created SearchNodes: 444938 Cache Hits: 4983 Action Selection: Exploitation in Root: 87711 Exploration in Root: 5262 Percentage Exploration in Root: 0.0565971 Skipped backups: 1270490173 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.0838 (in 92977 real visits) Q-Value Estimates: noop() : -18.9856 (in 1755 real visits) roll(d3) : -16.0838 (in 87712 real visits) roll(d2) : -27.6072 (in 1755 real visits) roll(d1) : -27.6145 (in 1755 real visits) Used RAM: 282600 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.379423s. THTS: Maximal search depth set to 65 Search time: 0.379426s Statistics of THTS: Performed trials: 95142 Created SearchNodes: 455051 Cache Hits: 5166 Action Selection: Exploitation in Root: 75432 Exploration in Root: 19710 Percentage Exploration in Root: 0.207164 Skipped backups: 1270988185 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0093 (in 95146 real visits) Q-Value Estimates: noop() : -12.1869 (in 16861 real visits) roll(d3) : -12.0093 (in 75273 real visits) roll(d2) : -15.5949 (in 1506 real visits) roll(d1) : -15.6359 (in 1506 real visits) Used RAM: 282600 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 5 1 | horizon: 65 Setting time for this decision to 0.379423s. THTS: Maximal search depth set to 65 Search time: 0.379426s Statistics of THTS: Performed trials: 93837 Created SearchNodes: 448754 Cache Hits: 5109 Action Selection: Exploitation in Root: 88528 Exploration in Root: 5309 Percentage Exploration in Root: 0.0565768 Skipped backups: 1271483273 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.0672 (in 93841 real visits) Q-Value Estimates: noop() : -17.1439 (in 1771 real visits) roll(d3) : -15.0672 (in 88528 real visits) roll(d2) : -25.3407 (in 1771 real visits) roll(d1) : -25.5295 (in 1771 real visits) Used RAM: 282600 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** >>> END OF ROUND 1 -- REWARD RECEIVED: -85 *********************************************** *********************************************** >>> STARTING ROUND 2 -- REMAINING TIME 245s *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.413797s. THTS: Maximal search depth set to 65 Search time: 0.413802s Statistics of THTS: Performed trials: 112254 Created SearchNodes: 558827 Cache Hits: 612 Action Selection: Exploitation in Root: 54072 Exploration in Root: 58182 Percentage Exploration in Root: 0.518307 Skipped backups: 1272012735 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.6774 (in 112258 real visits) Q-Value Estimates: noop() : -68.1861 (in 769 real visits) roll(d3) : -61.6974 (in 36773 real visits) roll(d2) : -61.6868 (in 37389 real visits) roll(d1) : -61.6774 (in 37327 real visits) Used RAM: 282844 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 0 0 | horizon: 65 Setting time for this decision to 0.413795s. THTS: Maximal search depth set to 65 Search time: 0.413799s Statistics of THTS: Performed trials: 108194 Created SearchNodes: 529311 Cache Hits: 2916 Action Selection: Exploitation in Root: 74892 Exploration in Root: 33302 Percentage Exploration in Root: 0.307799 Skipped backups: 1272527805 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.4805 (in 108198 real visits) Q-Value Estimates: noop() : -41.513 (in 1073 real visits) roll(d3) : -36.4805 (in 53617 real visits) roll(d2) : -36.4884 (in 52435 real visits) roll(d1) : -51.4023 (in 1073 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 0 3 | horizon: 65 Setting time for this decision to 0.413794s. THTS: Maximal search depth set to 65 Search time: 0.413798s Statistics of THTS: Performed trials: 106777 Created SearchNodes: 522822 Cache Hits: 2767 Action Selection: Exploitation in Root: 98962 Exploration in Root: 7815 Percentage Exploration in Root: 0.0731899 Skipped backups: 1273066347 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -29.299 (in 106781 real visits) Q-Value Estimates: noop() : -31.4985 (in 1980 real visits) roll(d3) : -30.5971 (in 3860 real visits) roll(d2) : -29.299 (in 98961 real visits) roll(d1) : -40.0351 (in 1980 real visits) Used RAM: 282844 Submitted action: roll(d2) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 1 3 | horizon: 65 Setting time for this decision to 0.413794s. THTS: Maximal search depth set to 65 Search time: 0.413799s Statistics of THTS: Performed trials: 107665 Created SearchNodes: 527326 Cache Hits: 2751 Action Selection: Exploitation in Root: 96325 Exploration in Root: 11340 Percentage Exploration in Root: 0.105327 Skipped backups: 1273603681 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -28.2839 (in 107669 real visits) Q-Value Estimates: noop() : -29.8137 (in 2773 real visits) roll(d3) : -29.1573 (in 6644 real visits) roll(d2) : -28.2839 (in 96325 real visits) roll(d1) : -37.6361 (in 1927 real visits) Used RAM: 282844 Submitted action: roll(d2) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 3 | horizon: 65 Setting time for this decision to 0.413792s. THTS: Maximal search depth set to 65 Search time: 0.413797s Statistics of THTS: Performed trials: 101839 Created SearchNodes: 487244 Cache Hits: 5489 Action Selection: Exploitation in Root: 92800 Exploration in Root: 9039 Percentage Exploration in Root: 0.0887577 Skipped backups: 1274142679 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.0899 (in 101843 real visits) Q-Value Estimates: noop() : -13.5669 (in 5343 real visits) roll(d3) : -13.0899 (in 92788 real visits) roll(d2) : -19.9043 (in 1856 real visits) roll(d1) : -19.8825 (in 1856 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 2 | horizon: 65 Setting time for this decision to 0.41379s. THTS: Maximal search depth set to 65 Search time: 0.413794s Statistics of THTS: Performed trials: 101697 Created SearchNodes: 486286 Cache Hits: 5551 Action Selection: Exploitation in Root: 95944 Exploration in Root: 5753 Percentage Exploration in Root: 0.05657 Skipped backups: 1274682377 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.0869 (in 101701 real visits) Q-Value Estimates: noop() : -15.1109 (in 1919 real visits) roll(d3) : -14.0869 (in 95944 real visits) roll(d2) : -22.7663 (in 1919 real visits) roll(d1) : -22.9742 (in 1919 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 3 | horizon: 65 Setting time for this decision to 0.413789s. THTS: Maximal search depth set to 65 Search time: 0.413802s Statistics of THTS: Performed trials: 101912 Created SearchNodes: 487257 Cache Hits: 5577 Action Selection: Exploitation in Root: 93669 Exploration in Root: 8243 Percentage Exploration in Root: 0.0808835 Skipped backups: 1275220555 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.0897 (in 101916 real visits) Q-Value Estimates: noop() : -13.6129 (in 4504 real visits) roll(d3) : -13.0897 (in 93664 real visits) roll(d2) : -19.5951 (in 1874 real visits) roll(d1) : -19.702 (in 1874 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 1 | horizon: 65 Setting time for this decision to 0.413787s. THTS: Maximal search depth set to 65 Search time: 0.413792s Statistics of THTS: Performed trials: 100915 Created SearchNodes: 482996 Cache Hits: 5396 Action Selection: Exploitation in Root: 95204 Exploration in Root: 5711 Percentage Exploration in Root: 0.0565922 Skipped backups: 1275758299 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.113 (in 100919 real visits) Q-Value Estimates: noop() : -17.1732 (in 1905 real visits) roll(d3) : -15.113 (in 95204 real visits) roll(d2) : -25.3604 (in 1905 real visits) roll(d1) : -25.6509 (in 1905 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.413787s. THTS: Maximal search depth set to 65 Search time: 0.413791s Statistics of THTS: Performed trials: 102684 Created SearchNodes: 491245 Cache Hits: 5545 Action Selection: Exploitation in Root: 82458 Exploration in Root: 20226 Percentage Exploration in Root: 0.196973 Skipped backups: 1276302259 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0478 (in 102688 real visits) Q-Value Estimates: noop() : -12.2198 (in 16980 real visits) roll(d3) : -12.0478 (in 82410 real visits) roll(d2) : -15.9228 (in 1649 real visits) roll(d1) : -15.6393 (in 1649 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.413786s. THTS: Maximal search depth set to 65 Search time: 0.413791s Statistics of THTS: Performed trials: 102919 Created SearchNodes: 492236 Cache Hits: 5591 Action Selection: Exploitation in Root: 81711 Exploration in Root: 21208 Percentage Exploration in Root: 0.206065 Skipped backups: 1276845321 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0423 (in 102923 real visits) Q-Value Estimates: noop() : -12.2078 (in 18124 real visits) roll(d3) : -12.0423 (in 81537 real visits) roll(d2) : -15.6491 (in 1631 real visits) roll(d1) : -15.6483 (in 1631 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 0 | horizon: 65 Setting time for this decision to 0.413784s. THTS: Maximal search depth set to 65 Search time: 0.413799s Statistics of THTS: Performed trials: 101600 Created SearchNodes: 485857 Cache Hits: 5537 Action Selection: Exploitation in Root: 95852 Exploration in Root: 5748 Percentage Exploration in Root: 0.0565748 Skipped backups: 1277386065 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.1033 (in 101604 real visits) Q-Value Estimates: noop() : -19.1417 (in 1918 real visits) roll(d3) : -16.1033 (in 95851 real visits) roll(d2) : -27.6932 (in 1918 real visits) roll(d1) : -27.8119 (in 1917 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 1 | horizon: 65 Setting time for this decision to 0.413784s. THTS: Maximal search depth set to 65 Search time: 0.413789s Statistics of THTS: Performed trials: 101506 Created SearchNodes: 485351 Cache Hits: 5546 Action Selection: Exploitation in Root: 95762 Exploration in Root: 5744 Percentage Exploration in Root: 0.0565878 Skipped backups: 1277925523 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.0877 (in 101510 real visits) Q-Value Estimates: noop() : -17.288 (in 1916 real visits) roll(d3) : -15.0877 (in 95762 real visits) roll(d2) : -25.4883 (in 1916 real visits) roll(d1) : -25.2785 (in 1916 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 1 | horizon: 65 Setting time for this decision to 0.413784s. THTS: Maximal search depth set to 65 Search time: 0.413789s Statistics of THTS: Performed trials: 101228 Created SearchNodes: 484329 Cache Hits: 5454 Action Selection: Exploitation in Root: 95502 Exploration in Root: 5726 Percentage Exploration in Root: 0.0565654 Skipped backups: 1278466179 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.1068 (in 101232 real visits) Q-Value Estimates: noop() : -17.1192 (in 1911 real visits) roll(d3) : -15.1068 (in 95501 real visits) roll(d2) : -25.3091 (in 1910 real visits) roll(d1) : -25.2924 (in 1910 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.413781s. THTS: Maximal search depth set to 65 Search time: 0.413784s Statistics of THTS: Performed trials: 102953 Created SearchNodes: 492650 Cache Hits: 5530 Action Selection: Exploitation in Root: 81295 Exploration in Root: 21658 Percentage Exploration in Root: 0.210368 Skipped backups: 1279013743 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0469 (in 102957 real visits) Q-Value Estimates: noop() : -12.215 (in 18548 real visits) roll(d3) : -12.0469 (in 81161 real visits) roll(d2) : -15.7208 (in 1624 real visits) roll(d1) : -15.911 (in 1624 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.413781s. THTS: Maximal search depth set to 65 Search time: 0.413784s Statistics of THTS: Performed trials: 100961 Created SearchNodes: 483058 Cache Hits: 5438 Action Selection: Exploitation in Root: 80691 Exploration in Root: 20270 Percentage Exploration in Root: 0.200771 Skipped backups: 1279544507 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0235 (in 100965 real visits) Q-Value Estimates: noop() : -12.2002 (in 17188 real visits) roll(d3) : -12.0235 (in 80553 real visits) roll(d2) : -15.687 (in 1612 real visits) roll(d1) : -15.7245 (in 1612 real visits) Used RAM: 282844 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 2 -- REWARD RECEIVED: -66 *********************************************** *********************************************** >>> STARTING ROUND 3 -- REMAINING TIME 238s *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.453565s. THTS: Maximal search depth set to 65 Search time: 0.453571s Statistics of THTS: Performed trials: 124897 Created SearchNodes: 621718 Cache Hits: 693 Action Selection: Exploitation in Root: 50505 Exploration in Root: 74392 Percentage Exploration in Root: 0.595627 Skipped backups: 1280141121 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.7914 (in 124901 real visits) Q-Value Estimates: noop() : -68.8028 (in 849 real visits) roll(d3) : -61.7914 (in 42444 real visits) roll(d2) : -61.8085 (in 41108 real visits) roll(d1) : -61.8116 (in 40500 real visits) Used RAM: 288652 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 0 0 5 | horizon: 65 Setting time for this decision to 0.453565s. THTS: Maximal search depth set to 65 Search time: 0.453568s Statistics of THTS: Performed trials: 118374 Created SearchNodes: 579215 Cache Hits: 3165 Action Selection: Exploitation in Root: 73663 Exploration in Root: 44711 Percentage Exploration in Root: 0.37771 Skipped backups: 1280713415 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.5872 (in 118378 real visits) Q-Value Estimates: noop() : -41.6805 (in 1170 real visits) roll(d3) : -51.3194 (in 1170 real visits) roll(d2) : -36.5872 (in 57566 real visits) roll(d1) : -36.5895 (in 58472 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 0 2 5 | horizon: 65 Setting time for this decision to 0.453564s. THTS: Maximal search depth set to 65 Search time: 0.453569s Statistics of THTS: Performed trials: 116991 Created SearchNodes: 572804 Cache Hits: 3039 Action Selection: Exploitation in Root: 100108 Exploration in Root: 16883 Percentage Exploration in Root: 0.14431 Skipped backups: 1281297033 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -32.3409 (in 116995 real visits) Q-Value Estimates: noop() : -35.6045 (in 2003 real visits) roll(d3) : -44.6566 (in 2002 real visits) roll(d2) : -32.9722 (in 12889 real visits) roll(d1) : -32.3409 (in 100101 real visits) Used RAM: 288916 Submitted action: roll(d1) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 0.453561s. THTS: Maximal search depth set to 65 Search time: 0.453565s Statistics of THTS: Performed trials: 110749 Created SearchNodes: 529650 Cache Hits: 6025 Action Selection: Exploitation in Root: 104483 Exploration in Root: 6266 Percentage Exploration in Root: 0.0565784 Skipped backups: 1281894373 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.1402 (in 110753 real visits) Q-Value Estimates: noop() : -15.2541 (in 2090 real visits) roll(d3) : -22.9909 (in 2090 real visits) roll(d2) : -14.1402 (in 104483 real visits) roll(d1) : -23.0219 (in 2090 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.45356s. THTS: Maximal search depth set to 65 Search time: 0.453564s Statistics of THTS: Performed trials: 111651 Created SearchNodes: 534280 Cache Hits: 5995 Action Selection: Exploitation in Root: 90170 Exploration in Root: 21481 Percentage Exploration in Root: 0.192394 Skipped backups: 1282494185 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0854 (in 111655 real visits) Q-Value Estimates: noop() : -12.2558 (in 18003 real visits) roll(d3) : -15.7568 (in 1801 real visits) roll(d2) : -12.0854 (in 90050 real visits) roll(d1) : -15.641 (in 1801 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 0.453559s. THTS: Maximal search depth set to 65 Search time: 0.453565s Statistics of THTS: Performed trials: 110680 Created SearchNodes: 528897 Cache Hits: 6127 Action Selection: Exploitation in Root: 104417 Exploration in Root: 6263 Percentage Exploration in Root: 0.0565866 Skipped backups: 1283089715 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.1207 (in 110684 real visits) Q-Value Estimates: noop() : -15.2894 (in 2089 real visits) roll(d3) : -23.1469 (in 2089 real visits) roll(d2) : -14.1207 (in 104417 real visits) roll(d1) : -23.0565 (in 2089 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 1 5 | horizon: 65 Setting time for this decision to 0.453558s. THTS: Maximal search depth set to 65 Search time: 0.453563s Statistics of THTS: Performed trials: 110412 Created SearchNodes: 528173 Cache Hits: 5973 Action Selection: Exploitation in Root: 104168 Exploration in Root: 6244 Percentage Exploration in Root: 0.0565518 Skipped backups: 1283681069 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.1242 (in 110416 real visits) Q-Value Estimates: noop() : -17.273 (in 2084 real visits) roll(d3) : -25.8023 (in 2084 real visits) roll(d2) : -15.1242 (in 104164 real visits) roll(d1) : -25.6234 (in 2084 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.453558s. THTS: Maximal search depth set to 65 Search time: 0.453563s Statistics of THTS: Performed trials: 111548 Created SearchNodes: 533473 Cache Hits: 6068 Action Selection: Exploitation in Root: 89431 Exploration in Root: 22117 Percentage Exploration in Root: 0.198273 Skipped backups: 1284278347 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0578 (in 111552 real visits) Q-Value Estimates: noop() : -12.2323 (in 18715 real visits) roll(d3) : -15.6633 (in 1786 real visits) roll(d2) : -12.0578 (in 89265 real visits) roll(d1) : -15.7735 (in 1786 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 3 5 | horizon: 65 Setting time for this decision to 0.453557s. THTS: Maximal search depth set to 65 Search time: 0.453562s Statistics of THTS: Performed trials: 110656 Created SearchNodes: 529109 Cache Hits: 6044 Action Selection: Exploitation in Root: 101513 Exploration in Root: 9143 Percentage Exploration in Root: 0.0826254 Skipped backups: 1284870621 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.1272 (in 110660 real visits) Q-Value Estimates: noop() : -13.6237 (in 5088 real visits) roll(d3) : -19.7793 (in 2031 real visits) roll(d2) : -13.1272 (in 101510 real visits) roll(d1) : -19.8863 (in 2031 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 0.453556s. THTS: Maximal search depth set to 65 Search time: 0.453562s Statistics of THTS: Performed trials: 110308 Created SearchNodes: 527301 Cache Hits: 6061 Action Selection: Exploitation in Root: 104071 Exploration in Root: 6237 Percentage Exploration in Root: 0.0565417 Skipped backups: 1285463045 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.12 (in 110312 real visits) Q-Value Estimates: noop() : -15.1118 (in 2082 real visits) roll(d3) : -23.0218 (in 2082 real visits) roll(d2) : -14.12 (in 104066 real visits) roll(d1) : -23.1415 (in 2082 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 5 1 5 | horizon: 65 Setting time for this decision to 0.453555s. THTS: Maximal search depth set to 65 Search time: 0.45356s Statistics of THTS: Performed trials: 110498 Created SearchNodes: 528363 Cache Hits: 6033 Action Selection: Exploitation in Root: 104247 Exploration in Root: 6251 Percentage Exploration in Root: 0.0565712 Skipped backups: 1286056675 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.1305 (in 110502 real visits) Q-Value Estimates: noop() : -17.0844 (in 2085 real visits) roll(d3) : -25.6352 (in 2085 real visits) roll(d2) : -15.1305 (in 104247 real visits) roll(d1) : -25.4958 (in 2085 real visits) Used RAM: 288916 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** >>> END OF ROUND 3 -- REWARD RECEIVED: -54 *********************************************** *********************************************** >>> STARTING ROUND 4 -- REMAINING TIME 233s *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.50738s. THTS: Maximal search depth set to 65 Search time: 0.507386s Statistics of THTS: Performed trials: 138484 Created SearchNodes: 689145 Cache Hits: 820 Action Selection: Exploitation in Root: 64965 Exploration in Root: 73519 Percentage Exploration in Root: 0.530884 Skipped backups: 1286728965 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.9428 (in 138488 real visits) Q-Value Estimates: noop() : -68.6926 (in 932 real visits) roll(d3) : -61.9481 (in 46086 real visits) roll(d2) : -61.9616 (in 44893 real visits) roll(d1) : -61.9428 (in 46577 real visits) Used RAM: 295252 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 0 0 | horizon: 65 Setting time for this decision to 0.507379s. THTS: Maximal search depth set to 65 Search time: 0.507382s Statistics of THTS: Performed trials: 135590 Created SearchNodes: 674879 Cache Hits: 769 Action Selection: Exploitation in Root: 81867 Exploration in Root: 53723 Percentage Exploration in Root: 0.396217 Skipped backups: 1287394759 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -55.4353 (in 135594 real visits) Q-Value Estimates: noop() : -60.8509 (in 1284 real visits) roll(d3) : -55.4395 (in 63434 real visits) roll(d2) : -55.4353 (in 64161 real visits) roll(d1) : -57.0096 (in 6715 real visits) Used RAM: 295252 Submitted action: roll(d2) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 2 0 | horizon: 65 Setting time for this decision to 0.507377s. THTS: Maximal search depth set to 65 Search time: 0.507381s Statistics of THTS: Performed trials: 136740 Created SearchNodes: 680729 Cache Hits: 744 Action Selection: Exploitation in Root: 97609 Exploration in Root: 39131 Percentage Exploration in Root: 0.286171 Skipped backups: 1288058535 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -50.7656 (in 136744 real visits) Q-Value Estimates: noop() : -54.6389 (in 1953 real visits) roll(d3) : -50.7656 (in 97607 real visits) roll(d2) : -51.4922 (in 18552 real visits) roll(d1) : -51.4874 (in 18632 real visits) Used RAM: 295252 Submitted action: roll(d3) Immediate reward: -11 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 2 1 | horizon: 65 Setting time for this decision to 0.507376s. THTS: Maximal search depth set to 65 Search time: 0.507381s Statistics of THTS: Performed trials: 137902 Created SearchNodes: 686655 Cache Hits: 715 Action Selection: Exploitation in Root: 76365 Exploration in Root: 61537 Percentage Exploration in Root: 0.446237 Skipped backups: 1288705535 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -49.3758 (in 137906 real visits) Q-Value Estimates: noop() : -52.5403 (in 2023 real visits) roll(d3) : -49.3758 (in 76356 real visits) roll(d2) : -49.7322 (in 30750 real visits) roll(d1) : -49.7654 (in 28777 real visits) Used RAM: 295252 Submitted action: roll(d3) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 2 5 | horizon: 65 Setting time for this decision to 0.507377s. THTS: Maximal search depth set to 65 Search time: 0.50738s Statistics of THTS: Performed trials: 131522 Created SearchNodes: 643787 Cache Hits: 3457 Action Selection: Exploitation in Root: 95552 Exploration in Root: 35970 Percentage Exploration in Root: 0.27349 Skipped backups: 1289340787 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -29.8575 (in 131526 real visits) Q-Value Estimates: noop() : -31.4096 (in 2813 real visits) roll(d3) : -39.1426 (in 1280 real visits) roll(d2) : -29.8575 (in 63979 real visits) roll(d1) : -29.8719 (in 63454 real visits) Used RAM: 295252 Submitted action: roll(d2) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 1 5 | horizon: 65 Setting time for this decision to 0.507376s. THTS: Maximal search depth set to 65 Search time: 0.507378s Statistics of THTS: Performed trials: 130820 Created SearchNodes: 640613 Cache Hits: 3373 Action Selection: Exploitation in Root: 96241 Exploration in Root: 34579 Percentage Exploration in Root: 0.264325 Skipped backups: 1289982111 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -31.2981 (in 130824 real visits) Q-Value Estimates: noop() : -33.4302 (in 1925 real visits) roll(d3) : -42.1625 (in 1925 real visits) roll(d2) : -31.2981 (in 96220 real visits) roll(d1) : -31.5663 (in 30754 real visits) Used RAM: 295252 Submitted action: roll(d2) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 2 5 | horizon: 65 Setting time for this decision to 0.50737s. THTS: Maximal search depth set to 65 Search time: 0.507382s Statistics of THTS: Performed trials: 131473 Created SearchNodes: 644094 Cache Hits: 3319 Action Selection: Exploitation in Root: 89977 Exploration in Root: 41496 Percentage Exploration in Root: 0.315624 Skipped backups: 1290617583 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -29.913 (in 131477 real visits) Q-Value Estimates: noop() : -31.4776 (in 2720 real visits) roll(d3) : -38.9935 (in 1294 real visits) roll(d2) : -29.913 (in 64678 real visits) roll(d1) : -29.9183 (in 62785 real visits) Used RAM: 295252 Submitted action: roll(d2) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 5 5 | horizon: 65 Setting time for this decision to 0.507368s. THTS: Maximal search depth set to 65 Search time: 0.507372s Statistics of THTS: Performed trials: 121738 Created SearchNodes: 582439 Cache Hits: 6564 Action Selection: Exploitation in Root: 114855 Exploration in Root: 6883 Percentage Exploration in Root: 0.0565395 Skipped backups: 1291278177 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.1659 (in 121742 real visits) Q-Value Estimates: noop() : -15.2479 (in 2297 real visits) roll(d3) : -23.033 (in 2297 real visits) roll(d2) : -22.9962 (in 2297 real visits) roll(d1) : -14.1659 (in 114851 real visits) Used RAM: 295252 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 0 5 5 | horizon: 65 Setting time for this decision to 0.507367s. THTS: Maximal search depth set to 65 Search time: 0.507374s Statistics of THTS: Performed trials: 121692 Created SearchNodes: 581749 Cache Hits: 6679 Action Selection: Exploitation in Root: 114807 Exploration in Root: 6885 Percentage Exploration in Root: 0.0565773 Skipped backups: 1291939621 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.1479 (in 121696 real visits) Q-Value Estimates: noop() : -19.2756 (in 2297 real visits) roll(d3) : -27.8905 (in 2297 real visits) roll(d2) : -27.9053 (in 2297 real visits) roll(d1) : -16.1479 (in 114805 real visits) Used RAM: 295252 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** >>> END OF ROUND 4 -- REWARD RECEIVED: -76 *********************************************** *********************************************** >>> STARTING ROUND 5 -- REMAINING TIME 229s *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.580218s. THTS: Maximal search depth set to 65 Search time: 0.580221s Statistics of THTS: Performed trials: 156078 Created SearchNodes: 776667 Cache Hits: 932 Action Selection: Exploitation in Root: 76771 Exploration in Root: 79307 Percentage Exploration in Root: 0.508124 Skipped backups: 1292709181 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.1118 (in 156082 real visits) Q-Value Estimates: noop() : -68.9667 (in 1065 real visits) roll(d3) : -62.1348 (in 51442 real visits) roll(d2) : -62.1434 (in 50327 real visits) roll(d1) : -62.1118 (in 53248 real visits) Used RAM: 303436 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 3 0 0 | horizon: 65 Setting time for this decision to 0.580216s. THTS: Maximal search depth set to 65 Search time: 0.580219s Statistics of THTS: Performed trials: 152271 Created SearchNodes: 757932 Cache Hits: 857 Action Selection: Exploitation in Root: 104229 Exploration in Root: 48042 Percentage Exploration in Root: 0.315503 Skipped backups: 1293487229 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -51.0254 (in 152275 real visits) Q-Value Estimates: noop() : -55.2065 (in 1490 real visits) roll(d3) : -51.0254 (in 74497 real visits) roll(d2) : -51.0266 (in 74147 real visits) roll(d1) : -54.1896 (in 2141 real visits) Used RAM: 303436 Submitted action: roll(d3) Immediate reward: -12 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 3 0 0 | horizon: 65 Setting time for this decision to 0.580214s. THTS: Maximal search depth set to 65 Search time: 0.580217s Statistics of THTS: Performed trials: 151791 Created SearchNodes: 755336 Cache Hits: 906 Action Selection: Exploitation in Root: 105892 Exploration in Root: 45899 Percentage Exploration in Root: 0.302383 Skipped backups: 1294262645 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -50.9613 (in 151795 real visits) Q-Value Estimates: noop() : -55.1389 (in 1483 real visits) roll(d3) : -50.9729 (in 74131 real visits) roll(d2) : -50.9613 (in 74117 real visits) roll(d1) : -54.209 (in 2064 real visits) Used RAM: 303436 Submitted action: roll(d2) Immediate reward: -12 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 3 4 0 | horizon: 65 Setting time for this decision to 0.580212s. THTS: Maximal search depth set to 65 Search time: 0.580216s Statistics of THTS: Performed trials: 150023 Created SearchNodes: 747004 Cache Hits: 779 Action Selection: Exploitation in Root: 134488 Exploration in Root: 15535 Percentage Exploration in Root: 0.103551 Skipped backups: 1295066199 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -37.8519 (in 150027 real visits) Q-Value Estimates: noop() : -39.7483 (in 3365 real visits) roll(d3) : -37.8519 (in 134488 real visits) roll(d2) : -41.5015 (in 2690 real visits) roll(d1) : -38.8374 (in 9484 real visits) Used RAM: 303436 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 3 4 1 | horizon: 65 Setting time for this decision to 0.580212s. THTS: Maximal search depth set to 65 Search time: 0.580219s Statistics of THTS: Performed trials: 150912 Created SearchNodes: 751853 Cache Hits: 678 Action Selection: Exploitation in Root: 126794 Exploration in Root: 24118 Percentage Exploration in Root: 0.159815 Skipped backups: 1295860473 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.7874 (in 150916 real visits) Q-Value Estimates: noop() : -38.277 (in 4853 real visits) roll(d3) : -36.7874 (in 126784 real visits) roll(d2) : -39.0743 (in 2536 real visits) roll(d1) : -37.4151 (in 16743 real visits) Used RAM: 303436 Submitted action: roll(d3) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 3 4 3 | horizon: 65 Setting time for this decision to 0.58021s. THTS: Maximal search depth set to 65 Search time: 0.580215s Statistics of THTS: Performed trials: 153775 Created SearchNodes: 766276 Cache Hits: 651 Action Selection: Exploitation in Root: 90888 Exploration in Root: 62887 Percentage Exploration in Root: 0.408955 Skipped backups: 1296626409 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.8032 (in 153779 real visits) Q-Value Estimates: noop() : -34.5147 (in 10342 real visits) roll(d3) : -33.8032 (in 68309 real visits) roll(d2) : -34.718 (in 7373 real visits) roll(d1) : -33.8034 (in 67755 real visits) Used RAM: 303436 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 3 4 5 | horizon: 65 Setting time for this decision to 0.580208s. THTS: Maximal search depth set to 65 Search time: 0.580212s Statistics of THTS: Performed trials: 143060 Created SearchNodes: 701773 Cache Hits: 3383 Action Selection: Exploitation in Root: 112644 Exploration in Root: 30416 Percentage Exploration in Root: 0.21261 Skipped backups: 1297380889 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.4805 (in 143064 real visits) Q-Value Estimates: noop() : -22.8854 (in 15685 real visits) roll(d3) : -26.3676 (in 2253 real visits) roll(d2) : -22.9431 (in 12489 real visits) roll(d1) : -22.4805 (in 112637 real visits) Used RAM: 303436 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 2 4 5 | horizon: 65 Setting time for this decision to 0.580206s. THTS: Maximal search depth set to 65 Search time: 0.580211s Statistics of THTS: Performed trials: 145425 Created SearchNodes: 713114 Cache Hits: 3504 Action Selection: Exploitation in Root: 130878 Exploration in Root: 14547 Percentage Exploration in Root: 0.100031 Skipped backups: 1298171019 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.6026 (in 145429 real visits) Q-Value Estimates: noop() : -24.29 (in 8130 real visits) roll(d3) : -29.9798 (in 2618 real visits) roll(d2) : -24.7055 (in 3805 real visits) roll(d1) : -23.6026 (in 130876 real visits) Used RAM: 303436 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 4 5 | horizon: 65 Setting time for this decision to 0.580204s. THTS: Maximal search depth set to 65 Search time: 0.58021s Statistics of THTS: Performed trials: 150728 Created SearchNodes: 739949 Cache Hits: 3424 Action Selection: Exploitation in Root: 91660 Exploration in Root: 59068 Percentage Exploration in Root: 0.391885 Skipped backups: 1298938961 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -20.7495 (in 150732 real visits) Q-Value Estimates: noop() : -20.8773 (in 29578 real visits) roll(d3) : -22.1398 (in 1820 real visits) roll(d2) : -20.7495 (in 59537 real visits) roll(d1) : -20.751 (in 59797 real visits) Used RAM: 303436 Submitted action: roll(d2) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 0 5 | horizon: 65 Setting time for this decision to 0.580202s. THTS: Maximal search depth set to 65 Search time: 0.580205s Statistics of THTS: Performed trials: 145146 Created SearchNodes: 711575 Cache Hits: 3540 Action Selection: Exploitation in Root: 136934 Exploration in Root: 8212 Percentage Exploration in Root: 0.0565775 Skipped backups: 1299735077 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.6596 (in 145150 real visits) Q-Value Estimates: noop() : -27.2165 (in 2739 real visits) roll(d3) : -35.1566 (in 2739 real visits) roll(d2) : -25.6596 (in 136933 real visits) roll(d1) : -29.1569 (in 2739 real visits) Used RAM: 303436 Submitted action: roll(d2) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.580203s. THTS: Maximal search depth set to 65 Search time: 0.580208s Statistics of THTS: Performed trials: 138932 Created SearchNodes: 664413 Cache Hits: 7563 Action Selection: Exploitation in Root: 112237 Exploration in Root: 26695 Percentage Exploration in Root: 0.192144 Skipped backups: 1300495833 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.1488 (in 138936 real visits) Q-Value Estimates: noop() : -12.3036 (in 22452 real visits) roll(d3) : -16.0162 (in 2241 real visits) roll(d2) : -15.9275 (in 2241 real visits) roll(d1) : -12.1488 (in 112002 real visits) Used RAM: 303436 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 0 5 5 | horizon: 65 Setting time for this decision to 0.580201s. THTS: Maximal search depth set to 65 Search time: 0.580204s Statistics of THTS: Performed trials: 136691 Created SearchNodes: 653492 Cache Hits: 7492 Action Selection: Exploitation in Root: 128955 Exploration in Root: 7736 Percentage Exploration in Root: 0.0565948 Skipped backups: 1301248491 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.2115 (in 136695 real visits) Q-Value Estimates: noop() : -19.3655 (in 2580 real visits) roll(d3) : -27.9759 (in 2580 real visits) roll(d2) : -27.9079 (in 2580 real visits) roll(d1) : -16.2115 (in 128955 real visits) Used RAM: 303436 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.580198s. THTS: Maximal search depth set to 65 Search time: 0.580201s Statistics of THTS: Performed trials: 138472 Created SearchNodes: 662033 Cache Hits: 7583 Action Selection: Exploitation in Root: 112383 Exploration in Root: 26089 Percentage Exploration in Root: 0.188406 Skipped backups: 1302005899 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.1479 (in 138476 real visits) Q-Value Estimates: noop() : -12.3076 (in 21699 real visits) roll(d3) : -15.8498 (in 2246 real visits) roll(d2) : -16.1497 (in 2246 real visits) roll(d1) : -12.1479 (in 112285 real visits) Used RAM: 303436 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 5 -- REWARD RECEIVED: -81 *********************************************** *********************************************** >>> STARTING ROUND 6 -- REMAINING TIME 221s *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.673028s. THTS: Maximal search depth set to 65 Search time: 0.67303s Statistics of THTS: Performed trials: 178336 Created SearchNodes: 887425 Cache Hits: 1065 Action Selection: Exploitation in Root: 86739 Exploration in Root: 91597 Percentage Exploration in Root: 0.51362 Skipped backups: 1302900821 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.3785 (in 178340 real visits) Q-Value Estimates: noop() : -68.9213 (in 1199 real visits) roll(d3) : -62.38 (in 59928 real visits) roll(d2) : -62.3785 (in 58875 real visits) roll(d1) : -62.3946 (in 58338 real visits) Used RAM: 313732 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.673025s. THTS: Maximal search depth set to 65 Search time: 0.673027s Statistics of THTS: Performed trials: 177489 Created SearchNodes: 883166 Cache Hits: 1071 Action Selection: Exploitation in Root: 92768 Exploration in Root: 84721 Percentage Exploration in Root: 0.477331 Skipped backups: 1303789737 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.3571 (in 177493 real visits) Q-Value Estimates: noop() : -69.2593 (in 1180 real visits) roll(d3) : -62.3579 (in 58916 real visits) roll(d2) : -62.3571 (in 58993 real visits) roll(d1) : -62.3607 (in 58404 real visits) Used RAM: 313732 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 4 0 | horizon: 65 Setting time for this decision to 0.673025s. THTS: Maximal search depth set to 65 Search time: 0.67303s Statistics of THTS: Performed trials: 171303 Created SearchNodes: 853072 Cache Hits: 862 Action Selection: Exploitation in Root: 116968 Exploration in Root: 54335 Percentage Exploration in Root: 0.317187 Skipped backups: 1304697247 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -45.1294 (in 171307 real visits) Q-Value Estimates: noop() : -49.2005 (in 1701 real visits) roll(d3) : -45.1294 (in 85033 real visits) roll(d2) : -52.8644 (in 1701 real visits) roll(d1) : -45.1597 (in 82872 real visits) Used RAM: 313996 Submitted action: roll(d3) Immediate reward: -11 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 4 3 | horizon: 65 Setting time for this decision to 0.673022s. THTS: Maximal search depth set to 65 Search time: 0.673025s Statistics of THTS: Performed trials: 171069 Created SearchNodes: 851898 Cache Hits: 863 Action Selection: Exploitation in Root: 154716 Exploration in Root: 16353 Percentage Exploration in Root: 0.095593 Skipped backups: 1305631965 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -38.0382 (in 171073 real visits) Q-Value Estimates: noop() : -39.9556 (in 3499 real visits) roll(d3) : -39.0436 (in 9764 real visits) roll(d2) : -41.5247 (in 3095 real visits) roll(d1) : -38.0382 (in 154715 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 1 4 3 | horizon: 65 Setting time for this decision to 0.673019s. THTS: Maximal search depth set to 65 Search time: 0.673024s Statistics of THTS: Performed trials: 172140 Created SearchNodes: 857265 Cache Hits: 860 Action Selection: Exploitation in Root: 144793 Exploration in Root: 27347 Percentage Exploration in Root: 0.158865 Skipped backups: 1306555803 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.951 (in 172144 real visits) Q-Value Estimates: noop() : -38.3834 (in 5306 real visits) roll(d3) : -37.5424 (in 19150 real visits) roll(d2) : -39.1529 (in 2896 real visits) roll(d1) : -36.951 (in 144792 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 4 3 | horizon: 65 Setting time for this decision to 0.673019s. THTS: Maximal search depth set to 65 Search time: 0.673022s Statistics of THTS: Performed trials: 175767 Created SearchNodes: 875864 Cache Hits: 744 Action Selection: Exploitation in Root: 120250 Exploration in Root: 55517 Percentage Exploration in Root: 0.315856 Skipped backups: 1307449741 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.01 (in 175771 real visits) Q-Value Estimates: noop() : -34.7087 (in 11271 real visits) roll(d3) : -34.0113 (in 78191 real visits) roll(d2) : -34.9112 (in 8047 real visits) roll(d1) : -34.01 (in 78262 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 1 4 3 | horizon: 65 Setting time for this decision to 0.673016s. THTS: Maximal search depth set to 65 Search time: 0.673022s Statistics of THTS: Performed trials: 169647 Created SearchNodes: 844880 Cache Hits: 840 Action Selection: Exploitation in Root: 142365 Exploration in Root: 27282 Percentage Exploration in Root: 0.160816 Skipped backups: 1308357249 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.9152 (in 169651 real visits) Q-Value Estimates: noop() : -38.2965 (in 5607 real visits) roll(d3) : -37.5162 (in 18831 real visits) roll(d2) : -39.0432 (in 2848 real visits) roll(d1) : -36.9152 (in 142365 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 4 3 | horizon: 65 Setting time for this decision to 0.673016s. THTS: Maximal search depth set to 65 Search time: 0.673021s Statistics of THTS: Performed trials: 176035 Created SearchNodes: 877056 Cache Hits: 781 Action Selection: Exploitation in Root: 117779 Exploration in Root: 58256 Percentage Exploration in Root: 0.330934 Skipped backups: 1309249865 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.014 (in 176039 real visits) Q-Value Estimates: noop() : -34.6965 (in 11455 real visits) roll(d3) : -34.014 (in 77424 real visits) roll(d2) : -34.8866 (in 8392 real visits) roll(d1) : -34.0141 (in 78768 real visits) Used RAM: 313996 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 4 3 | horizon: 65 Setting time for this decision to 0.673013s. THTS: Maximal search depth set to 65 Search time: 0.673016s Statistics of THTS: Performed trials: 175748 Created SearchNodes: 875597 Cache Hits: 787 Action Selection: Exploitation in Root: 116966 Exploration in Root: 58782 Percentage Exploration in Root: 0.334468 Skipped backups: 1310143953 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.0337 (in 175752 real visits) Q-Value Estimates: noop() : -34.7363 (in 11153 real visits) roll(d3) : -34.0359 (in 78820 real visits) roll(d2) : -34.9457 (in 7855 real visits) roll(d1) : -34.0337 (in 77924 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 4 3 | horizon: 65 Setting time for this decision to 0.673013s. THTS: Maximal search depth set to 65 Search time: 0.673015s Statistics of THTS: Performed trials: 175092 Created SearchNodes: 872809 Cache Hits: 664 Action Selection: Exploitation in Root: 118160 Exploration in Root: 56932 Percentage Exploration in Root: 0.325155 Skipped backups: 1311052547 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.3705 (in 175096 real visits) Q-Value Estimates: noop() : -30.8302 (in 18956 real visits) roll(d3) : -30.3705 (in 118156 real visits) roll(d2) : -30.8305 (in 19009 real visits) roll(d1) : -30.8296 (in 18975 real visits) Used RAM: 313996 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 4 5 | horizon: 65 Setting time for this decision to 0.67301s. THTS: Maximal search depth set to 65 Search time: 0.673013s Statistics of THTS: Performed trials: 171833 Created SearchNodes: 843674 Cache Hits: 3874 Action Selection: Exploitation in Root: 113295 Exploration in Root: 58538 Percentage Exploration in Root: 0.340668 Skipped backups: 1311942655 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -20.9058 (in 171837 real visits) Q-Value Estimates: noop() : -21.0383 (in 32766 real visits) roll(d3) : -22.2731 (in 1979 real visits) roll(d2) : -20.9125 (in 68801 real visits) roll(d1) : -20.9058 (in 68291 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 1 4 5 | horizon: 65 Setting time for this decision to 0.673006s. THTS: Maximal search depth set to 65 Search time: 0.673011s Statistics of THTS: Performed trials: 165019 Created SearchNodes: 808712 Cache Hits: 4097 Action Selection: Exploitation in Root: 154133 Exploration in Root: 10886 Percentage Exploration in Root: 0.0659682 Skipped backups: 1312861147 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.7784 (in 165023 real visits) Q-Value Estimates: noop() : -25.8128 (in 4726 real visits) roll(d3) : -32.7039 (in 3083 real visits) roll(d2) : -26.8807 (in 3083 real visits) roll(d1) : -24.7784 (in 154131 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 1 4 5 | horizon: 65 Setting time for this decision to 0.673006s. THTS: Maximal search depth set to 65 Search time: 0.67301s Statistics of THTS: Performed trials: 166002 Created SearchNodes: 813223 Cache Hits: 4198 Action Selection: Exploitation in Root: 155076 Exploration in Root: 10926 Percentage Exploration in Root: 0.0658185 Skipped backups: 1313785281 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.7901 (in 166006 real visits) Q-Value Estimates: noop() : -25.8237 (in 4726 real visits) roll(d3) : -32.5613 (in 3102 real visits) roll(d2) : -27.066 (in 3102 real visits) roll(d1) : -24.7901 (in 155076 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 2 4 5 | horizon: 65 Setting time for this decision to 0.673003s. THTS: Maximal search depth set to 65 Search time: 0.673006s Statistics of THTS: Performed trials: 166255 Created SearchNodes: 814764 Cache Hits: 4129 Action Selection: Exploitation in Root: 150680 Exploration in Root: 15575 Percentage Exploration in Root: 0.0936814 Skipped backups: 1314706755 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.7568 (in 166259 real visits) Q-Value Estimates: noop() : -24.447 (in 8420 real visits) roll(d3) : -30.0258 (in 3014 real visits) roll(d2) : -24.8265 (in 4148 real visits) roll(d1) : -23.7568 (in 150677 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 4 5 | horizon: 65 Setting time for this decision to 0.673003s. THTS: Maximal search depth set to 65 Search time: 0.673008s Statistics of THTS: Performed trials: 165426 Created SearchNodes: 811467 Cache Hits: 3917 Action Selection: Exploitation in Root: 132077 Exploration in Root: 33349 Percentage Exploration in Root: 0.201595 Skipped backups: 1315598975 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.6365 (in 165430 real visits) Q-Value Estimates: noop() : -23.0211 (in 17204 real visits) roll(d3) : -26.5069 (in 2642 real visits) roll(d2) : -23.0955 (in 13516 real visits) roll(d1) : -22.6365 (in 132068 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 4 5 | horizon: 65 Setting time for this decision to 0.673s. THTS: Maximal search depth set to 65 Search time: 0.673003s Statistics of THTS: Performed trials: 165479 Created SearchNodes: 811120 Cache Hits: 4070 Action Selection: Exploitation in Root: 156118 Exploration in Root: 9361 Percentage Exploration in Root: 0.0565691 Skipped backups: 1316523711 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.8136 (in 165483 real visits) Q-Value Estimates: noop() : -27.219 (in 3123 real visits) roll(d3) : -35.1361 (in 3123 real visits) roll(d2) : -29.3532 (in 3123 real visits) roll(d1) : -25.8136 (in 156114 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 1 4 5 | horizon: 65 Setting time for this decision to 0.673s. THTS: Maximal search depth set to 65 Search time: 0.673006s Statistics of THTS: Performed trials: 165317 Created SearchNodes: 810246 Cache Hits: 4086 Action Selection: Exploitation in Root: 154268 Exploration in Root: 11049 Percentage Exploration in Root: 0.0668352 Skipped backups: 1317439783 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.7899 (in 165321 real visits) Q-Value Estimates: noop() : -25.8103 (in 4881 real visits) roll(d3) : -32.8002 (in 3086 real visits) roll(d2) : -26.9214 (in 3086 real visits) roll(d1) : -24.7899 (in 154268 real visits) Used RAM: 313996 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.672997s. THTS: Maximal search depth set to 65 Search time: 0.673002s Statistics of THTS: Performed trials: 157959 Created SearchNodes: 755456 Cache Hits: 8586 Action Selection: Exploitation in Root: 129006 Exploration in Root: 28953 Percentage Exploration in Root: 0.183294 Skipped backups: 1318316857 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.2111 (in 157963 real visits) Q-Value Estimates: noop() : -12.3668 (in 24001 real visits) roll(d3) : -16.3741 (in 2577 real visits) roll(d2) : -12.2111 (in 128808 real visits) roll(d1) : -16.1859 (in 2577 real visits) Used RAM: 313996 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 0.672997s. THTS: Maximal search depth set to 65 Search time: 0.673002s Statistics of THTS: Performed trials: 155988 Created SearchNodes: 745233 Cache Hits: 8678 Action Selection: Exploitation in Root: 147166 Exploration in Root: 8822 Percentage Exploration in Root: 0.0565556 Skipped backups: 1319180725 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.2388 (in 155992 real visits) Q-Value Estimates: noop() : -15.3773 (in 2944 real visits) roll(d3) : -23.3638 (in 2944 real visits) roll(d2) : -14.2388 (in 147160 real visits) roll(d1) : -23.4032 (in 2944 real visits) Used RAM: 313996 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** >>> END OF ROUND 6 -- REWARD RECEIVED: -116 *********************************************** *********************************************** >>> STARTING ROUND 7 -- REMAINING TIME 208s *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.792062s. THTS: Maximal search depth set to 65 Search time: 0.792064s Statistics of THTS: Performed trials: 206728 Created SearchNodes: 1028693 Cache Hits: 1238 Action Selection: Exploitation in Root: 97784 Exploration in Root: 108944 Percentage Exploration in Root: 0.526992 Skipped backups: 1320237637 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.617 (in 206732 real visits) Q-Value Estimates: noop() : -69.4907 (in 1391 real visits) roll(d3) : -62.6279 (in 67981 real visits) roll(d2) : -62.6252 (in 67831 real visits) roll(d1) : -62.617 (in 69529 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 0 | horizon: 65 Setting time for this decision to 0.792058s. THTS: Maximal search depth set to 65 Search time: 0.792061s Statistics of THTS: Performed trials: 203012 Created SearchNodes: 1010141 Cache Hits: 1231 Action Selection: Exploitation in Root: 120113 Exploration in Root: 82899 Percentage Exploration in Root: 0.408345 Skipped backups: 1321290333 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.1707 (in 203016 real visits) Q-Value Estimates: noop() : -62.0065 (in 1919 real visits) roll(d3) : -56.1707 (in 95787 real visits) roll(d2) : -56.1717 (in 95906 real visits) roll(d1) : -57.565 (in 9404 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 0 | horizon: 65 Setting time for this decision to 0.792054s. THTS: Maximal search depth set to 65 Search time: 0.792057s Statistics of THTS: Performed trials: 202189 Created SearchNodes: 1005758 Cache Hits: 1298 Action Selection: Exploitation in Root: 128276 Exploration in Root: 73913 Percentage Exploration in Root: 0.365564 Skipped backups: 1322338351 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.1111 (in 202193 real visits) Q-Value Estimates: noop() : -61.4005 (in 1925 real visits) roll(d3) : -56.1111 (in 95550 real visits) roll(d2) : -56.1171 (in 96220 real visits) roll(d1) : -57.6124 (in 8498 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 0 | horizon: 65 Setting time for this decision to 0.792054s. THTS: Maximal search depth set to 65 Search time: 0.792058s Statistics of THTS: Performed trials: 202877 Created SearchNodes: 1009482 Cache Hits: 1227 Action Selection: Exploitation in Root: 136477 Exploration in Root: 66400 Percentage Exploration in Root: 0.327292 Skipped backups: 1323389929 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.166 (in 202881 real visits) Q-Value Estimates: noop() : -61.4699 (in 1923 real visits) roll(d3) : -56.166 (in 96136 real visits) roll(d2) : -56.1673 (in 95430 real visits) roll(d1) : -57.5587 (in 9392 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 4 | horizon: 65 Setting time for this decision to 0.792051s. THTS: Maximal search depth set to 65 Search time: 0.792059s Statistics of THTS: Performed trials: 198248 Created SearchNodes: 986977 Cache Hits: 1067 Action Selection: Exploitation in Root: 158900 Exploration in Root: 39348 Percentage Exploration in Root: 0.198479 Skipped backups: 1324469311 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -41.206 (in 198252 real visits) Q-Value Estimates: noop() : -43.5509 (in 3178 real visits) roll(d3) : -46.291 (in 3178 real visits) roll(d2) : -41.206 (in 158884 real visits) roll(d1) : -41.6406 (in 33012 real visits) Used RAM: 327196 Submitted action: roll(d2) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.792047s. THTS: Maximal search depth set to 65 Search time: 0.79205s Statistics of THTS: Performed trials: 189564 Created SearchNodes: 929469 Cache Hits: 4589 Action Selection: Exploitation in Root: 171461 Exploration in Root: 18103 Percentage Exploration in Root: 0.0954981 Skipped backups: 1325538207 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.9021 (in 189568 real visits) Q-Value Estimates: noop() : -24.5332 (in 10323 real visits) roll(d3) : -24.97 (in 4354 real visits) roll(d2) : -30.1539 (in 3430 real visits) roll(d1) : -23.9021 (in 171461 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.792047s. THTS: Maximal search depth set to 65 Search time: 0.792052s Statistics of THTS: Performed trials: 190805 Created SearchNodes: 934710 Cache Hits: 4830 Action Selection: Exploitation in Root: 177953 Exploration in Root: 12852 Percentage Exploration in Root: 0.0673567 Skipped backups: 1326619079 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9513 (in 190809 real visits) Q-Value Estimates: noop() : -25.8939 (in 5736 real visits) roll(d3) : -27.3956 (in 3560 real visits) roll(d2) : -32.9226 (in 3560 real visits) roll(d1) : -24.9513 (in 177953 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.792043s. THTS: Maximal search depth set to 65 Search time: 0.792048s Statistics of THTS: Performed trials: 190522 Created SearchNodes: 933635 Cache Hits: 4745 Action Selection: Exploitation in Root: 178316 Exploration in Root: 12206 Percentage Exploration in Root: 0.0640661 Skipped backups: 1327700261 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9472 (in 190526 real visits) Q-Value Estimates: noop() : -25.9655 (in 5078 real visits) roll(d3) : -27.3528 (in 3567 real visits) roll(d2) : -32.9105 (in 3567 real visits) roll(d1) : -24.9472 (in 178314 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.792044s. THTS: Maximal search depth set to 65 Search time: 0.792046s Statistics of THTS: Performed trials: 197816 Created SearchNodes: 971137 Cache Hits: 4487 Action Selection: Exploitation in Root: 127817 Exploration in Root: 69999 Percentage Exploration in Root: 0.353859 Skipped backups: 1328745987 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0779 (in 197820 real visits) Q-Value Estimates: noop() : -21.1938 (in 38494 real visits) roll(d3) : -21.0812 (in 78258 real visits) roll(d2) : -22.475 (in 1980 real visits) roll(d1) : -21.0779 (in 79088 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.79204s. THTS: Maximal search depth set to 65 Search time: 0.792044s Statistics of THTS: Performed trials: 191482 Created SearchNodes: 938371 Cache Hits: 4761 Action Selection: Exploitation in Root: 173769 Exploration in Root: 17713 Percentage Exploration in Root: 0.0925048 Skipped backups: 1329824539 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.9279 (in 191486 real visits) Q-Value Estimates: noop() : -24.5614 (in 10055 real visits) roll(d3) : -25.0273 (in 4190 real visits) roll(d2) : -30.2247 (in 3476 real visits) roll(d1) : -23.9279 (in 173765 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.79204s. THTS: Maximal search depth set to 65 Search time: 0.792046s Statistics of THTS: Performed trials: 192083 Created SearchNodes: 941356 Cache Hits: 4766 Action Selection: Exploitation in Root: 173984 Exploration in Root: 18099 Percentage Exploration in Root: 0.0942249 Skipped backups: 1330907699 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.9298 (in 192087 real visits) Q-Value Estimates: noop() : -24.5576 (in 10205 real visits) roll(d3) : -24.9864 (in 4419 real visits) roll(d2) : -30.143 (in 3480 real visits) roll(d1) : -23.9298 (in 173983 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.792036s. THTS: Maximal search depth set to 65 Search time: 0.79204s Statistics of THTS: Performed trials: 190122 Created SearchNodes: 931635 Cache Hits: 4745 Action Selection: Exploitation in Root: 177828 Exploration in Root: 12294 Percentage Exploration in Root: 0.0646637 Skipped backups: 1331984171 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9436 (in 190126 real visits) Q-Value Estimates: noop() : -25.9535 (in 5184 real visits) roll(d3) : -27.197 (in 3557 real visits) roll(d2) : -32.8232 (in 3557 real visits) roll(d1) : -24.9436 (in 177828 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 3 5 4 | horizon: 65 Setting time for this decision to 0.792032s. THTS: Maximal search depth set to 65 Search time: 0.792037s Statistics of THTS: Performed trials: 193576 Created SearchNodes: 949125 Cache Hits: 4690 Action Selection: Exploitation in Root: 155739 Exploration in Root: 37837 Percentage Exploration in Root: 0.195463 Skipped backups: 1333044517 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.7905 (in 193580 real visits) Q-Value Estimates: noop() : -23.1842 (in 18894 real visits) roll(d3) : -23.2351 (in 15835 real visits) roll(d2) : -26.9829 (in 3115 real visits) roll(d1) : -22.7905 (in 155736 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.792032s. THTS: Maximal search depth set to 65 Search time: 0.792038s Statistics of THTS: Performed trials: 198048 Created SearchNodes: 971809 Cache Hits: 4609 Action Selection: Exploitation in Root: 116459 Exploration in Root: 81589 Percentage Exploration in Root: 0.411966 Skipped backups: 1334088849 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0667 (in 198052 real visits) Q-Value Estimates: noop() : -21.1875 (in 37182 real visits) roll(d3) : -21.067 (in 78185 real visits) roll(d2) : -22.3045 (in 2436 real visits) roll(d1) : -21.0667 (in 80249 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.792028s. THTS: Maximal search depth set to 65 Search time: 0.792031s Statistics of THTS: Performed trials: 197911 Created SearchNodes: 971412 Cache Hits: 4537 Action Selection: Exploitation in Root: 126941 Exploration in Root: 70970 Percentage Exploration in Root: 0.358596 Skipped backups: 1335131693 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0658 (in 197915 real visits) Q-Value Estimates: noop() : -21.1849 (in 37666 real visits) roll(d3) : -21.0681 (in 77580 real visits) roll(d2) : -22.3009 (in 2432 real visits) roll(d1) : -21.0658 (in 80237 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.792024s. THTS: Maximal search depth set to 65 Search time: 0.792027s Statistics of THTS: Performed trials: 189985 Created SearchNodes: 930550 Cache Hits: 4845 Action Selection: Exploitation in Root: 177471 Exploration in Root: 12514 Percentage Exploration in Root: 0.0658684 Skipped backups: 1336202089 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9528 (in 189989 real visits) Q-Value Estimates: noop() : -25.9376 (in 5418 real visits) roll(d3) : -27.1522 (in 3550 real visits) roll(d2) : -32.8856 (in 3550 real visits) roll(d1) : -24.9528 (in 177471 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.792025s. THTS: Maximal search depth set to 65 Search time: 0.792027s Statistics of THTS: Performed trials: 192288 Created SearchNodes: 942413 Cache Hits: 4758 Action Selection: Exploitation in Root: 174293 Exploration in Root: 17995 Percentage Exploration in Root: 0.0935836 Skipped backups: 1337288261 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.9433 (in 192292 real visits) Q-Value Estimates: noop() : -24.5892 (in 9838 real visits) roll(d3) : -24.9682 (in 4677 real visits) roll(d2) : -30.216 (in 3486 real visits) roll(d1) : -23.9433 (in 174291 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.792021s. THTS: Maximal search depth set to 65 Search time: 0.792025s Statistics of THTS: Performed trials: 190659 Created SearchNodes: 934224 Cache Hits: 4769 Action Selection: Exploitation in Root: 178045 Exploration in Root: 12614 Percentage Exploration in Root: 0.06616 Skipped backups: 1338369491 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9505 (in 190663 real visits) Q-Value Estimates: noop() : -25.9196 (in 5498 real visits) roll(d3) : -27.2118 (in 3561 real visits) roll(d2) : -32.977 (in 3561 real visits) roll(d1) : -24.9505 (in 178043 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.792021s. THTS: Maximal search depth set to 65 Search time: 0.792025s Statistics of THTS: Performed trials: 198803 Created SearchNodes: 975784 Cache Hits: 4559 Action Selection: Exploitation in Root: 128003 Exploration in Root: 70800 Percentage Exploration in Root: 0.356131 Skipped backups: 1339419487 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0791 (in 198807 real visits) Q-Value Estimates: noop() : -21.1998 (in 38272 real visits) roll(d3) : -21.0791 (in 80366 real visits) roll(d2) : -22.4824 (in 1992 real visits) roll(d1) : -21.0853 (in 78177 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.792017s. THTS: Maximal search depth set to 65 Search time: 0.792023s Statistics of THTS: Performed trials: 191433 Created SearchNodes: 937514 Cache Hits: 4914 Action Selection: Exploitation in Root: 180602 Exploration in Root: 10831 Percentage Exploration in Root: 0.0565785 Skipped backups: 1340505033 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9461 (in 191437 real visits) Q-Value Estimates: noop() : -27.4409 (in 3612 real visits) roll(d3) : -25.9461 (in 180601 real visits) roll(d2) : -35.4105 (in 3612 real visits) roll(d1) : -29.4647 (in 3612 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.792013s. THTS: Maximal search depth set to 65 Search time: 0.792017s Statistics of THTS: Performed trials: 190365 Created SearchNodes: 932974 Cache Hits: 4714 Action Selection: Exploitation in Root: 177809 Exploration in Root: 12556 Percentage Exploration in Root: 0.0659575 Skipped backups: 1341582785 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9561 (in 190369 real visits) Q-Value Estimates: noop() : -25.9321 (in 5448 real visits) roll(d3) : -24.9561 (in 177807 real visits) roll(d2) : -32.9418 (in 3557 real visits) roll(d1) : -27.1401 (in 3557 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.792013s. THTS: Maximal search depth set to 65 Search time: 0.792019s Statistics of THTS: Performed trials: 190682 Created SearchNodes: 934211 Cache Hits: 4801 Action Selection: Exploitation in Root: 178412 Exploration in Root: 12270 Percentage Exploration in Root: 0.064348 Skipped backups: 1342660857 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9394 (in 190686 real visits) Q-Value Estimates: noop() : -25.9494 (in 5136 real visits) roll(d3) : -24.9394 (in 178412 real visits) roll(d2) : -33.0468 (in 3569 real visits) roll(d1) : -27.1987 (in 3569 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.792008s. THTS: Maximal search depth set to 65 Search time: 0.792013s Statistics of THTS: Performed trials: 190331 Created SearchNodes: 932908 Cache Hits: 4688 Action Selection: Exploitation in Root: 179560 Exploration in Root: 10771 Percentage Exploration in Root: 0.0565909 Skipped backups: 1343742299 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9671 (in 190335 real visits) Q-Value Estimates: noop() : -27.4309 (in 3592 real visits) roll(d3) : -25.9671 (in 179559 real visits) roll(d2) : -35.3694 (in 3592 real visits) roll(d1) : -29.5026 (in 3592 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.792008s. THTS: Maximal search depth set to 65 Search time: 0.792015s Statistics of THTS: Performed trials: 191285 Created SearchNodes: 937014 Cache Hits: 4854 Action Selection: Exploitation in Root: 180459 Exploration in Root: 10826 Percentage Exploration in Root: 0.0565962 Skipped backups: 1344827995 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9756 (in 191289 real visits) Q-Value Estimates: noop() : -27.5438 (in 3610 real visits) roll(d3) : -25.9756 (in 180459 real visits) roll(d2) : -35.6144 (in 3610 real visits) roll(d1) : -29.5409 (in 3610 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.792004s. THTS: Maximal search depth set to 65 Search time: 0.792009s Statistics of THTS: Performed trials: 191818 Created SearchNodes: 939967 Cache Hits: 4782 Action Selection: Exploitation in Root: 179335 Exploration in Root: 12483 Percentage Exploration in Root: 0.0650773 Skipped backups: 1345915187 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9657 (in 191822 real visits) Q-Value Estimates: noop() : -25.9569 (in 5313 real visits) roll(d3) : -24.9657 (in 179335 real visits) roll(d2) : -32.858 (in 3587 real visits) roll(d1) : -27.2644 (in 3587 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 2 | horizon: 65 Setting time for this decision to 0.792004s. THTS: Maximal search depth set to 65 Search time: 0.792007s Statistics of THTS: Performed trials: 192694 Created SearchNodes: 944443 Cache Hits: 4758 Action Selection: Exploitation in Root: 174324 Exploration in Root: 18370 Percentage Exploration in Root: 0.0953325 Skipped backups: 1346999183 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.932 (in 192698 real visits) Q-Value Estimates: noop() : -24.5489 (in 10517 real visits) roll(d3) : -23.932 (in 174322 real visits) roll(d2) : -30.3846 (in 3487 real visits) roll(d1) : -24.9981 (in 4372 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.792s. THTS: Maximal search depth set to 65 Search time: 0.792004s Statistics of THTS: Performed trials: 192209 Created SearchNodes: 941590 Cache Hits: 4865 Action Selection: Exploitation in Root: 179524 Exploration in Root: 12685 Percentage Exploration in Root: 0.0659959 Skipped backups: 1348087827 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9566 (in 192213 real visits) Q-Value Estimates: noop() : -25.9286 (in 5508 real visits) roll(d3) : -24.9566 (in 179523 real visits) roll(d2) : -32.8829 (in 3591 real visits) roll(d1) : -27.2371 (in 3591 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791996s. THTS: Maximal search depth set to 65 Search time: 0.792001s Statistics of THTS: Performed trials: 198909 Created SearchNodes: 976350 Cache Hits: 4550 Action Selection: Exploitation in Root: 125199 Exploration in Root: 73710 Percentage Exploration in Root: 0.370571 Skipped backups: 1349141053 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0849 (in 198913 real visits) Q-Value Estimates: noop() : -21.2001 (in 39159 real visits) roll(d3) : -21.0892 (in 78098 real visits) roll(d2) : -22.437 (in 2120 real visits) roll(d1) : -21.0849 (in 79536 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791996s. THTS: Maximal search depth set to 65 Search time: 0.791998s Statistics of THTS: Performed trials: 198463 Created SearchNodes: 974148 Cache Hits: 4543 Action Selection: Exploitation in Root: 124172 Exploration in Root: 74291 Percentage Exploration in Root: 0.374332 Skipped backups: 1350190245 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0671 (in 198467 real visits) Q-Value Estimates: noop() : -21.1908 (in 37968 real visits) roll(d3) : -21.074 (in 79465 real visits) roll(d2) : -22.3782 (in 2278 real visits) roll(d1) : -21.0671 (in 78756 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 4 | horizon: 65 Setting time for this decision to 0.791991s. THTS: Maximal search depth set to 65 Search time: 0.791997s Statistics of THTS: Performed trials: 189411 Created SearchNodes: 927828 Cache Hits: 4808 Action Selection: Exploitation in Root: 178693 Exploration in Root: 10718 Percentage Exploration in Root: 0.0565859 Skipped backups: 1351266521 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9389 (in 189415 real visits) Q-Value Estimates: noop() : -27.4963 (in 3574 real visits) roll(d3) : -29.3807 (in 3574 real visits) roll(d2) : -35.4546 (in 3574 real visits) roll(d1) : -25.9389 (in 178693 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791991s. THTS: Maximal search depth set to 65 Search time: 0.791995s Statistics of THTS: Performed trials: 190362 Created SearchNodes: 932903 Cache Hits: 4728 Action Selection: Exploitation in Root: 177879 Exploration in Root: 12483 Percentage Exploration in Root: 0.0655751 Skipped backups: 1352345799 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9483 (in 190366 real visits) Q-Value Estimates: noop() : -25.9294 (in 5371 real visits) roll(d3) : -27.1004 (in 3558 real visits) roll(d2) : -32.9591 (in 3558 real visits) roll(d1) : -24.9483 (in 177879 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791987s. THTS: Maximal search depth set to 65 Search time: 0.79199s Statistics of THTS: Performed trials: 189752 Created SearchNodes: 929781 Cache Hits: 4746 Action Selection: Exploitation in Root: 177575 Exploration in Root: 12177 Percentage Exploration in Root: 0.0641732 Skipped backups: 1353418043 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.933 (in 189756 real visits) Q-Value Estimates: noop() : -25.947 (in 5078 real visits) roll(d3) : -27.242 (in 3552 real visits) roll(d2) : -33.0815 (in 3552 real visits) roll(d1) : -24.933 (in 177574 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791982s. THTS: Maximal search depth set to 65 Search time: 0.791989s Statistics of THTS: Performed trials: 198057 Created SearchNodes: 972090 Cache Hits: 4550 Action Selection: Exploitation in Root: 127036 Exploration in Root: 71021 Percentage Exploration in Root: 0.358589 Skipped backups: 1354466545 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0811 (in 198061 real visits) Q-Value Estimates: noop() : -21.1967 (in 38107 real visits) roll(d3) : -21.0824 (in 78461 real visits) roll(d2) : -22.3856 (in 2226 real visits) roll(d1) : -21.0811 (in 79267 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.791982s. THTS: Maximal search depth set to 65 Search time: 0.791989s Statistics of THTS: Performed trials: 190455 Created SearchNodes: 933484 Cache Hits: 4699 Action Selection: Exploitation in Root: 172400 Exploration in Root: 18055 Percentage Exploration in Root: 0.0947993 Skipped backups: 1355539753 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.9212 (in 190459 real visits) Q-Value Estimates: noop() : -24.556 (in 10064 real visits) roll(d3) : -24.9582 (in 4547 real visits) roll(d2) : -30.0626 (in 3448 real visits) roll(d1) : -23.9212 (in 172400 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791978s. THTS: Maximal search depth set to 65 Search time: 0.791984s Statistics of THTS: Performed trials: 190831 Created SearchNodes: 934872 Cache Hits: 4822 Action Selection: Exploitation in Root: 178174 Exploration in Root: 12657 Percentage Exploration in Root: 0.0663257 Skipped backups: 1356618725 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9555 (in 190835 real visits) Q-Value Estimates: noop() : -25.9292 (in 5533 real visits) roll(d3) : -27.1005 (in 3564 real visits) roll(d2) : -32.9485 (in 3564 real visits) roll(d1) : -24.9555 (in 178174 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791978s. THTS: Maximal search depth set to 65 Search time: 0.791982s Statistics of THTS: Performed trials: 190956 Created SearchNodes: 935229 Cache Hits: 4889 Action Selection: Exploitation in Root: 178207 Exploration in Root: 12749 Percentage Exploration in Root: 0.0667641 Skipped backups: 1357701241 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9449 (in 190960 real visits) Q-Value Estimates: noop() : -25.9054 (in 5625 real visits) roll(d3) : -27.1797 (in 3565 real visits) roll(d2) : -32.9404 (in 3565 real visits) roll(d1) : -24.9449 (in 178205 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 4 | horizon: 65 Setting time for this decision to 0.791973s. THTS: Maximal search depth set to 65 Search time: 0.791978s Statistics of THTS: Performed trials: 190877 Created SearchNodes: 935078 Cache Hits: 4828 Action Selection: Exploitation in Root: 180075 Exploration in Root: 10802 Percentage Exploration in Root: 0.0565914 Skipped backups: 1358785405 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9772 (in 190881 real visits) Q-Value Estimates: noop() : -27.462 (in 3602 real visits) roll(d3) : -29.3975 (in 3602 real visits) roll(d2) : -35.2769 (in 3602 real visits) roll(d1) : -25.9772 (in 180075 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 4 | horizon: 65 Setting time for this decision to 0.791969s. THTS: Maximal search depth set to 65 Search time: 0.791972s Statistics of THTS: Performed trials: 190346 Created SearchNodes: 932367 Cache Hits: 4842 Action Selection: Exploitation in Root: 179574 Exploration in Root: 10772 Percentage Exploration in Root: 0.0565917 Skipped backups: 1359863311 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.95 (in 190350 real visits) Q-Value Estimates: noop() : -27.3754 (in 3592 real visits) roll(d3) : -29.5013 (in 3592 real visits) roll(d2) : -35.3269 (in 3592 real visits) roll(d1) : -25.95 (in 179574 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791968s. THTS: Maximal search depth set to 65 Search time: 0.791975s Statistics of THTS: Performed trials: 197642 Created SearchNodes: 970267 Cache Hits: 4487 Action Selection: Exploitation in Root: 132127 Exploration in Root: 65515 Percentage Exploration in Root: 0.331483 Skipped backups: 1360910971 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0903 (in 197646 real visits) Q-Value Estimates: noop() : -21.2046 (in 38858 real visits) roll(d3) : -21.0903 (in 78595 real visits) roll(d2) : -22.4374 (in 2102 real visits) roll(d1) : -21.091 (in 78091 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.791964s. THTS: Maximal search depth set to 65 Search time: 0.791969s Statistics of THTS: Performed trials: 190598 Created SearchNodes: 933659 Cache Hits: 4834 Action Selection: Exploitation in Root: 179812 Exploration in Root: 10786 Percentage Exploration in Root: 0.0565903 Skipped backups: 1361993863 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9738 (in 190602 real visits) Q-Value Estimates: noop() : -27.5038 (in 3597 real visits) roll(d3) : -25.9738 (in 179811 real visits) roll(d2) : -35.291 (in 3597 real visits) roll(d1) : -29.4618 (in 3597 real visits) Used RAM: 327196 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.791964s. THTS: Maximal search depth set to 65 Search time: 0.791966s Statistics of THTS: Performed trials: 183335 Created SearchNodes: 876308 Cache Hits: 10093 Action Selection: Exploitation in Root: 149046 Exploration in Root: 34289 Percentage Exploration in Root: 0.187029 Skipped backups: 1363029411 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.2549 (in 183339 real visits) Q-Value Estimates: noop() : -12.3988 (in 28455 real visits) roll(d3) : -16.4451 (in 2979 real visits) roll(d2) : -16.2875 (in 2979 real visits) roll(d1) : -12.2549 (in 148926 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 5 | horizon: 65 Setting time for this decision to 0.791959s. THTS: Maximal search depth set to 65 Search time: 0.791961s Statistics of THTS: Performed trials: 180818 Created SearchNodes: 864263 Cache Hits: 9958 Action Selection: Exploitation in Root: 170586 Exploration in Root: 10232 Percentage Exploration in Root: 0.0565873 Skipped backups: 1364052463 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.3046 (in 180822 real visits) Q-Value Estimates: noop() : -19.4291 (in 3412 real visits) roll(d3) : -28.5706 (in 3412 real visits) roll(d2) : -28.5012 (in 3412 real visits) roll(d1) : -16.3046 (in 170586 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 5 | horizon: 65 Setting time for this decision to 0.791959s. THTS: Maximal search depth set to 65 Search time: 0.791965s Statistics of THTS: Performed trials: 180791 Created SearchNodes: 864124 Cache Hits: 9959 Action Selection: Exploitation in Root: 170559 Exploration in Root: 10232 Percentage Exploration in Root: 0.0565957 Skipped backups: 1365073479 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.3109 (in 180795 real visits) Q-Value Estimates: noop() : -17.4696 (in 3412 real visits) roll(d3) : -26.1511 (in 3412 real visits) roll(d2) : -26.1348 (in 3412 real visits) roll(d1) : -15.3109 (in 170559 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 5 | horizon: 65 Setting time for this decision to 0.791954s. THTS: Maximal search depth set to 65 Search time: 0.79196s Statistics of THTS: Performed trials: 181210 Created SearchNodes: 865955 Cache Hits: 10025 Action Selection: Exploitation in Root: 170954 Exploration in Root: 10256 Percentage Exploration in Root: 0.0565973 Skipped backups: 1366098047 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.3112 (in 181214 real visits) Q-Value Estimates: noop() : -19.3675 (in 3420 real visits) roll(d3) : -28.4825 (in 3420 real visits) roll(d2) : -28.3494 (in 3420 real visits) roll(d1) : -16.3112 (in 170954 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.791954s. THTS: Maximal search depth set to 65 Search time: 0.791957s Statistics of THTS: Performed trials: 183341 Created SearchNodes: 876374 Cache Hits: 10084 Action Selection: Exploitation in Root: 150159 Exploration in Root: 33182 Percentage Exploration in Root: 0.180985 Skipped backups: 1367132239 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.2577 (in 183345 real visits) Q-Value Estimates: noop() : -12.4095 (in 27310 real visits) roll(d3) : -16.5381 (in 3001 real visits) roll(d2) : -16.3486 (in 3001 real visits) roll(d1) : -12.2577 (in 150033 real visits) Used RAM: 327196 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 7 -- REWARD RECEIVED: -229 *********************************************** *********************************************** >>> STARTING ROUND 8 -- REMAINING TIME 173s *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.873174s. THTS: Maximal search depth set to 65 Search time: 0.873179s Statistics of THTS: Performed trials: 224790 Created SearchNodes: 1118259 Cache Hits: 1424 Action Selection: Exploitation in Root: 109448 Exploration in Root: 115342 Percentage Exploration in Root: 0.51311 Skipped backups: 1368295455 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.7763 (in 224794 real visits) Q-Value Estimates: noop() : -69.8796 (in 1509 real visits) roll(d3) : -62.7763 (in 75426 real visits) roll(d2) : -62.7851 (in 73843 real visits) roll(d1) : -62.78 (in 74016 real visits) Used RAM: 335644 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.87317s. THTS: Maximal search depth set to 65 Search time: 0.873176s Statistics of THTS: Performed trials: 223369 Created SearchNodes: 1111250 Cache Hits: 1400 Action Selection: Exploitation in Root: 108332 Exploration in Root: 115037 Percentage Exploration in Root: 0.515009 Skipped backups: 1369450389 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.7567 (in 223373 real visits) Q-Value Estimates: noop() : -69.6713 (in 1487 real visits) roll(d3) : -62.7567 (in 74325 real visits) roll(d2) : -62.7575 (in 74195 real visits) roll(d1) : -62.762 (in 73366 real visits) Used RAM: 335644 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 0 5 | horizon: 65 Setting time for this decision to 0.873166s. THTS: Maximal search depth set to 65 Search time: 0.87317s Statistics of THTS: Performed trials: 209846 Created SearchNodes: 1026127 Cache Hits: 5777 Action Selection: Exploitation in Root: 145580 Exploration in Root: 64266 Percentage Exploration in Root: 0.306253 Skipped backups: 1370548167 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -37.1492 (in 209850 real visits) Q-Value Estimates: noop() : -42.0442 (in 2074 real visits) roll(d3) : -52.0884 (in 2074 real visits) roll(d2) : -37.1492 (in 103676 real visits) roll(d1) : -37.157 (in 102026 real visits) Used RAM: 335644 Submitted action: roll(d2) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 1 5 | horizon: 65 Setting time for this decision to 0.873161s. THTS: Maximal search depth set to 65 Search time: 0.873165s Statistics of THTS: Performed trials: 211566 Created SearchNodes: 1034999 Cache Hits: 5709 Action Selection: Exploitation in Root: 152447 Exploration in Root: 59119 Percentage Exploration in Root: 0.279435 Skipped backups: 1371665001 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -35.3056 (in 211570 real visits) Q-Value Estimates: noop() : -39.471 (in 3048 real visits) roll(d3) : -49.3976 (in 3048 real visits) roll(d2) : -35.5296 (in 53082 real visits) roll(d1) : -35.3056 (in 152392 real visits) Used RAM: 335644 Submitted action: roll(d1) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 1 5 | horizon: 65 Setting time for this decision to 0.873162s. THTS: Maximal search depth set to 65 Search time: 0.873168s Statistics of THTS: Performed trials: 211488 Created SearchNodes: 1034189 Cache Hits: 5814 Action Selection: Exploitation in Root: 151942 Exploration in Root: 59546 Percentage Exploration in Root: 0.281557 Skipped backups: 1372777127 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -35.2948 (in 211492 real visits) Q-Value Estimates: noop() : -39.439 (in 3039 real visits) roll(d3) : -49.3836 (in 3039 real visits) roll(d2) : -35.5128 (in 53474 real visits) roll(d1) : -35.2948 (in 151940 real visits) Used RAM: 335644 Submitted action: roll(d1) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 4 1 5 | horizon: 65 Setting time for this decision to 0.873158s. THTS: Maximal search depth set to 65 Search time: 0.873163s Statistics of THTS: Performed trials: 208682 Created SearchNodes: 1022219 Cache Hits: 5299 Action Selection: Exploitation in Root: 195561 Exploration in Root: 13121 Percentage Exploration in Root: 0.0628756 Skipped backups: 1373973931 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.0505 (in 208686 real visits) Q-Value Estimates: noop() : -26.0678 (in 5302 real visits) roll(d3) : -33.2112 (in 3912 real visits) roll(d2) : -25.0505 (in 195560 real visits) roll(d1) : -27.3807 (in 3912 real visits) Used RAM: 335644 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.873153s. THTS: Maximal search depth set to 65 Search time: 0.873159s Statistics of THTS: Performed trials: 198484 Created SearchNodes: 948433 Cache Hits: 10998 Action Selection: Exploitation in Root: 161588 Exploration in Root: 36896 Percentage Exploration in Root: 0.185889 Skipped backups: 1375103485 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.2921 (in 198488 real visits) Q-Value Estimates: noop() : -12.432 (in 30593 real visits) roll(d3) : -16.6989 (in 3229 real visits) roll(d2) : -16.4203 (in 3229 real visits) roll(d1) : -12.2921 (in 161437 real visits) Used RAM: 335644 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 8 -- REWARD RECEIVED: -64 *********************************************** *********************************************** >>> STARTING ROUND 9 -- REMAINING TIME 167s *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 1.26271s. THTS: Maximal search depth set to 65 Search time: 1.26271s Statistics of THTS: Performed trials: 318944 Created SearchNodes: 1586217 Cache Hits: 2127 Action Selection: Exploitation in Root: 157635 Exploration in Root: 161309 Percentage Exploration in Root: 0.50576 Skipped backups: 1376817285 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -63.3575 (in 318948 real visits) Q-Value Estimates: noop() : -70.4134 (in 2138 real visits) roll(d3) : -63.366 (in 104784 real visits) roll(d2) : -63.3575 (in 106891 real visits) roll(d1) : -63.3644 (in 105135 real visits) Used RAM: 379732 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 2 0 | horizon: 65 Setting time for this decision to 1.26271s. THTS: Maximal search depth set to 65 Search time: 1.26271s Statistics of THTS: Performed trials: 310316 Created SearchNodes: 1543225 Cache Hits: 2090 Action Selection: Exploitation in Root: 183439 Exploration in Root: 126877 Percentage Exploration in Root: 0.408864 Skipped backups: 1378515423 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.8672 (in 310320 real visits) Q-Value Estimates: noop() : -62.1963 (in 2948 real visits) roll(d3) : -56.8748 (in 147351 real visits) roll(d2) : -58.1502 (in 12698 real visits) roll(d1) : -56.8672 (in 147323 real visits) Used RAM: 379732 Submitted action: roll(d1) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 2 0 | horizon: 65 Setting time for this decision to 1.2627s. THTS: Maximal search depth set to 65 Search time: 1.2627s Statistics of THTS: Performed trials: 309380 Created SearchNodes: 1538625 Cache Hits: 2070 Action Selection: Exploitation in Root: 215690 Exploration in Root: 93690 Percentage Exploration in Root: 0.302831 Skipped backups: 1380208735 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.8835 (in 309384 real visits) Q-Value Estimates: noop() : -62.0866 (in 2940 real visits) roll(d3) : -56.8835 (in 146470 real visits) roll(d2) : -58.1316 (in 12974 real visits) roll(d1) : -56.8838 (in 147000 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 2 2 | horizon: 65 Setting time for this decision to 1.26269s. THTS: Maximal search depth set to 65 Search time: 1.2627s Statistics of THTS: Performed trials: 308829 Created SearchNodes: 1536350 Cache Hits: 1950 Action Selection: Exploitation in Root: 223730 Exploration in Root: 85099 Percentage Exploration in Root: 0.275554 Skipped backups: 1381875891 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -52.1868 (in 308833 real visits) Q-Value Estimates: noop() : -55.941 (in 4475 real visits) roll(d3) : -52.7163 (in 40482 real visits) roll(d2) : -52.72 (in 40157 real visits) roll(d1) : -52.1868 (in 223719 real visits) Used RAM: 379732 Submitted action: roll(d1) Immediate reward: -11 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 2 | horizon: 65 Setting time for this decision to 1.26269s. THTS: Maximal search depth set to 65 Search time: 1.26269s Statistics of THTS: Performed trials: 295086 Created SearchNodes: 1443399 Cache Hits: 8009 Action Selection: Exploitation in Root: 213660 Exploration in Root: 81426 Percentage Exploration in Root: 0.27594 Skipped backups: 1383468179 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.7064 (in 295090 real visits) Q-Value Estimates: noop() : -32.0251 (in 4611 real visits) roll(d3) : -30.7064 (in 145117 real visits) roll(d2) : -30.7084 (in 142459 real visits) roll(d1) : -40.0497 (in 2903 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 2 | horizon: 65 Setting time for this decision to 1.26268s. THTS: Maximal search depth set to 65 Search time: 1.26269s Statistics of THTS: Performed trials: 295757 Created SearchNodes: 1446430 Cache Hits: 8090 Action Selection: Exploitation in Root: 225279 Exploration in Root: 70478 Percentage Exploration in Root: 0.238297 Skipped backups: 1385063047 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.7272 (in 295761 real visits) Q-Value Estimates: noop() : -32.042 (in 4676 real visits) roll(d3) : -30.7272 (in 144887 real visits) roll(d2) : -30.7294 (in 143300 real visits) roll(d1) : -40.0021 (in 2898 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 0 | horizon: 65 Setting time for this decision to 1.26268s. THTS: Maximal search depth set to 65 Search time: 1.26268s Statistics of THTS: Performed trials: 291065 Created SearchNodes: 1422918 Cache Hits: 8103 Action Selection: Exploitation in Root: 251499 Exploration in Root: 39566 Percentage Exploration in Root: 0.135935 Skipped backups: 1386703387 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.3122 (in 291069 real visits) Q-Value Estimates: noop() : -36.8299 (in 5030 real visits) roll(d3) : -33.3122 (in 251498 real visits) roll(d2) : -33.7644 (in 29511 real visits) roll(d1) : -46.1976 (in 5030 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 0 | horizon: 65 Setting time for this decision to 1.26267s. THTS: Maximal search depth set to 65 Search time: 1.26268s Statistics of THTS: Performed trials: 291050 Created SearchNodes: 1422819 Cache Hits: 8109 Action Selection: Exploitation in Root: 253741 Exploration in Root: 37309 Percentage Exploration in Root: 0.128188 Skipped backups: 1388344849 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.3116 (in 291054 real visits) Q-Value Estimates: noop() : -36.5755 (in 5075 real visits) roll(d3) : -33.3116 (in 253739 real visits) roll(d2) : -33.7932 (in 27165 real visits) roll(d1) : -46.1544 (in 5075 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 0 | horizon: 65 Setting time for this decision to 1.26267s. THTS: Maximal search depth set to 65 Search time: 1.26268s Statistics of THTS: Performed trials: 291166 Created SearchNodes: 1423575 Cache Hits: 8065 Action Selection: Exploitation in Root: 253040 Exploration in Root: 38126 Percentage Exploration in Root: 0.130942 Skipped backups: 1389990909 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.3075 (in 291170 real visits) Q-Value Estimates: noop() : -36.8601 (in 5061 real visits) roll(d3) : -33.3075 (in 253034 real visits) roll(d2) : -33.7791 (in 28014 real visits) roll(d1) : -46.1566 (in 5061 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 3 | horizon: 65 Setting time for this decision to 1.26266s. THTS: Maximal search depth set to 65 Search time: 1.26267s Statistics of THTS: Performed trials: 294477 Created SearchNodes: 1440134 Cache Hits: 8064 Action Selection: Exploitation in Root: 236678 Exploration in Root: 57799 Percentage Exploration in Root: 0.196277 Skipped backups: 1391636991 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -28.2483 (in 294481 real visits) Q-Value Estimates: noop() : -29.1482 (in 8304 real visits) roll(d3) : -28.5184 (in 44773 real visits) roll(d2) : -28.2483 (in 236670 real visits) roll(d1) : -36.5622 (in 4734 real visits) Used RAM: 379732 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 3 | horizon: 65 Setting time for this decision to 1.26266s. THTS: Maximal search depth set to 65 Search time: 1.26266s Statistics of THTS: Performed trials: 294724 Created SearchNodes: 1443665 Cache Hits: 7490 Action Selection: Exploitation in Root: 241370 Exploration in Root: 53354 Percentage Exploration in Root: 0.18103 Skipped backups: 1393351877 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.2739 (in 294728 real visits) Q-Value Estimates: noop() : -23.6124 (in 27197 real visits) roll(d3) : -23.2739 (in 241363 real visits) roll(d2) : -23.6656 (in 21340 real visits) roll(d1) : -27.7187 (in 4828 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 1 | horizon: 65 Setting time for this decision to 1.26266s. THTS: Maximal search depth set to 65 Search time: 1.26266s Statistics of THTS: Performed trials: 289396 Created SearchNodes: 1416521 Cache Hits: 7616 Action Selection: Exploitation in Root: 271455 Exploration in Root: 17941 Percentage Exploration in Root: 0.0619946 Skipped backups: 1395078475 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.3865 (in 289400 real visits) Q-Value Estimates: noop() : -26.2875 (in 7085 real visits) roll(d3) : -25.3865 (in 271455 real visits) roll(d2) : -27.7124 (in 5430 real visits) roll(d1) : -33.5151 (in 5430 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 3 | horizon: 65 Setting time for this decision to 1.26265s. THTS: Maximal search depth set to 65 Search time: 1.26266s Statistics of THTS: Performed trials: 294856 Created SearchNodes: 1444553 Cache Hits: 7433 Action Selection: Exploitation in Root: 240544 Exploration in Root: 54312 Percentage Exploration in Root: 0.184198 Skipped backups: 1396790449 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.2659 (in 294860 real visits) Q-Value Estimates: noop() : -23.5908 (in 28289 real visits) roll(d3) : -23.2659 (in 240539 real visits) roll(d2) : -23.6666 (in 21221 real visits) roll(d1) : -27.724 (in 4811 real visits) Used RAM: 379732 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 1.26264s. THTS: Maximal search depth set to 65 Search time: 1.26265s Statistics of THTS: Performed trials: 273656 Created SearchNodes: 1308153 Cache Hits: 15033 Action Selection: Exploitation in Root: 226280 Exploration in Root: 47376 Percentage Exploration in Root: 0.173122 Skipped backups: 1398413951 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.4337 (in 273660 real visits) Q-Value Estimates: noop() : -12.5662 (in 38444 real visits) roll(d3) : -16.9751 (in 4524 real visits) roll(d2) : -12.4337 (in 226168 real visits) roll(d1) : -16.9858 (in 4524 real visits) Used RAM: 379732 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 9 -- REWARD RECEIVED: -105 *********************************************** *********************************************** >>> STARTING ROUND 10 -- REMAINING TIME 149s *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 2.25332s. THTS: Maximal search depth set to 65 Search time: 2.25333s Statistics of THTS: Performed trials: 542384 Created SearchNodes: 2696573 Cache Hits: 3838 Action Selection: Exploitation in Root: 272999 Exploration in Root: 269385 Percentage Exploration in Root: 0.496668 Skipped backups: 1401507183 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -64.2185 (in 542388 real visits) Q-Value Estimates: noop() : -71.7764 (in 3616 real visits) roll(d3) : -64.2196 (in 180134 real visits) roll(d2) : -64.2185 (in 180783 real visits) roll(d1) : -64.223 (in 177855 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 1 0 | horizon: 65 Setting time for this decision to 2.25331s. THTS: Maximal search depth set to 65 Search time: 2.25332s Statistics of THTS: Performed trials: 525251 Created SearchNodes: 2611200 Cache Hits: 3765 Action Selection: Exploitation in Root: 312445 Exploration in Root: 212806 Percentage Exploration in Root: 0.405151 Skipped backups: 1404501997 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.3902 (in 525255 real visits) Q-Value Estimates: noop() : -67.468 (in 4489 real visits) roll(d3) : -61.3902 (in 224030 real visits) roll(d2) : -61.7499 (in 72332 real visits) roll(d1) : -61.3905 (in 224404 real visits) Used RAM: 483748 Submitted action: roll(d3) Immediate reward: -14 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 1 0 | horizon: 65 Setting time for this decision to 2.2533s. THTS: Maximal search depth set to 65 Search time: 2.2533s Statistics of THTS: Performed trials: 525806 Created SearchNodes: 2614051 Cache Hits: 3746 Action Selection: Exploitation in Root: 315250 Exploration in Root: 210556 Percentage Exploration in Root: 0.400444 Skipped backups: 1407500863 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.3918 (in 525810 real visits) Q-Value Estimates: noop() : -67.7843 (in 4493 real visits) roll(d3) : -61.3918 (in 223740 real visits) roll(d2) : -61.749 (in 72939 real visits) roll(d1) : -61.3941 (in 224638 real visits) Used RAM: 483748 Submitted action: roll(d3) Immediate reward: -14 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 1 5 | horizon: 65 Setting time for this decision to 2.25329s. THTS: Maximal search depth set to 65 Search time: 2.25329s Statistics of THTS: Performed trials: 487720 Created SearchNodes: 2383553 Cache Hits: 13763 Action Selection: Exploitation in Root: 353859 Exploration in Root: 133861 Percentage Exploration in Root: 0.274463 Skipped backups: 1410378911 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.1697 (in 487724 real visits) Q-Value Estimates: noop() : -40.5292 (in 7077 real visits) roll(d3) : -50.8931 (in 7077 real visits) roll(d2) : -36.3314 (in 119732 real visits) roll(d1) : -36.1697 (in 353838 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 1 1 5 | horizon: 65 Setting time for this decision to 2.25328s. THTS: Maximal search depth set to 65 Search time: 2.25329s Statistics of THTS: Performed trials: 496872 Created SearchNodes: 2427557 Cache Hits: 14202 Action Selection: Exploitation in Root: 307556 Exploration in Root: 189316 Percentage Exploration in Root: 0.381016 Skipped backups: 1413265501 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.7898 (in 496876 real visits) Q-Value Estimates: noop() : -37.6914 (in 4904 real visits) roll(d3) : -47.3504 (in 4904 real visits) roll(d2) : -34.7902 (in 245152 real visits) roll(d1) : -34.7898 (in 241916 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 1 5 | horizon: 65 Setting time for this decision to 2.25327s. THTS: Maximal search depth set to 65 Search time: 2.25327s Statistics of THTS: Performed trials: 493629 Created SearchNodes: 2411886 Cache Hits: 14066 Action Selection: Exploitation in Root: 356194 Exploration in Root: 137435 Percentage Exploration in Root: 0.278418 Skipped backups: 1416178719 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.1911 (in 493633 real visits) Q-Value Estimates: noop() : -40.5588 (in 7124 real visits) roll(d3) : -50.8607 (in 7124 real visits) roll(d2) : -36.344 (in 123204 real visits) roll(d1) : -36.1911 (in 356181 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 1 1 5 | horizon: 65 Setting time for this decision to 2.25325s. THTS: Maximal search depth set to 65 Search time: 2.25326s Statistics of THTS: Performed trials: 497691 Created SearchNodes: 2431556 Cache Hits: 14226 Action Selection: Exploitation in Root: 357159 Exploration in Root: 140532 Percentage Exploration in Root: 0.282368 Skipped backups: 1419067407 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.7874 (in 497695 real visits) Q-Value Estimates: noop() : -37.7282 (in 4883 real visits) roll(d3) : -47.285 (in 4883 real visits) roll(d2) : -34.7879 (in 243808 real visits) roll(d1) : -34.7874 (in 244121 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 1 5 | horizon: 65 Setting time for this decision to 2.25324s. THTS: Maximal search depth set to 65 Search time: 2.25325s Statistics of THTS: Performed trials: 487450 Created SearchNodes: 2384563 Cache Hits: 13172 Action Selection: Exploitation in Root: 457917 Exploration in Root: 29533 Percentage Exploration in Root: 0.0605867 Skipped backups: 1422172123 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9182 (in 487454 real visits) Q-Value Estimates: noop() : -26.6657 (in 11220 real visits) roll(d3) : -34.4272 (in 9159 real visits) roll(d2) : -25.9182 (in 457916 real visits) roll(d1) : -28.2757 (in 9159 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 2 5 | horizon: 65 Setting time for this decision to 2.25323s. THTS: Maximal search depth set to 65 Search time: 2.25323s Statistics of THTS: Performed trials: 489889 Created SearchNodes: 2396570 Cache Hits: 13220 Action Selection: Exploitation in Root: 451074 Exploration in Root: 38815 Percentage Exploration in Root: 0.0792322 Skipped backups: 1425282425 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9163 (in 489893 real visits) Q-Value Estimates: noop() : -25.4021 (in 20777 real visits) roll(d3) : -31.9266 (in 9022 real visits) roll(d2) : -24.9163 (in 451072 real visits) roll(d1) : -25.8332 (in 9022 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 2 5 | horizon: 65 Setting time for this decision to 2.25321s. THTS: Maximal search depth set to 65 Search time: 2.25322s Statistics of THTS: Performed trials: 491592 Created SearchNodes: 2406029 Cache Hits: 12984 Action Selection: Exploitation in Root: 453181 Exploration in Root: 38411 Percentage Exploration in Root: 0.0781359 Skipped backups: 1428411903 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9137 (in 491596 real visits) Q-Value Estimates: noop() : -25.4168 (in 20289 real visits) roll(d3) : -31.8202 (in 9064 real visits) roll(d2) : -24.9137 (in 453179 real visits) roll(d1) : -25.7573 (in 9064 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 1 5 | horizon: 65 Setting time for this decision to 2.2532s. THTS: Maximal search depth set to 65 Search time: 2.25321s Statistics of THTS: Performed trials: 488303 Created SearchNodes: 2389036 Cache Hits: 13121 Action Selection: Exploitation in Root: 459218 Exploration in Root: 29085 Percentage Exploration in Root: 0.0595634 Skipped backups: 1431516755 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9172 (in 488307 real visits) Q-Value Estimates: noop() : -26.6866 (in 10719 real visits) roll(d3) : -34.5433 (in 9185 real visits) roll(d2) : -25.9172 (in 459218 real visits) roll(d1) : -28.2457 (in 9185 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 2 5 | horizon: 65 Setting time for this decision to 2.2532s. THTS: Maximal search depth set to 65 Search time: 2.25321s Statistics of THTS: Performed trials: 488854 Created SearchNodes: 2391551 Cache Hits: 13181 Action Selection: Exploitation in Root: 450085 Exploration in Root: 38769 Percentage Exploration in Root: 0.0793059 Skipped backups: 1434610481 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9078 (in 488858 real visits) Q-Value Estimates: noop() : -25.4114 (in 20240 real visits) roll(d3) : -31.7627 (in 9002 real visits) roll(d2) : -24.9078 (in 450083 real visits) roll(d1) : -25.7039 (in 9533 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 1 5 | horizon: 65 Setting time for this decision to 2.25319s. THTS: Maximal search depth set to 65 Search time: 2.25319s Statistics of THTS: Performed trials: 490032 Created SearchNodes: 2397325 Cache Hits: 13210 Action Selection: Exploitation in Root: 460759 Exploration in Root: 29273 Percentage Exploration in Root: 0.0597369 Skipped backups: 1437736911 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9435 (in 490036 real visits) Q-Value Estimates: noop() : -26.7074 (in 10848 real visits) roll(d3) : -34.684 (in 9216 real visits) roll(d2) : -25.9435 (in 460756 real visits) roll(d1) : -28.2846 (in 9216 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 1 5 | horizon: 65 Setting time for this decision to 2.25317s. THTS: Maximal search depth set to 65 Search time: 2.25318s Statistics of THTS: Performed trials: 488619 Created SearchNodes: 2390908 Cache Hits: 13048 Action Selection: Exploitation in Root: 459714 Exploration in Root: 28905 Percentage Exploration in Root: 0.0591565 Skipped backups: 1440846125 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9165 (in 488623 real visits) Q-Value Estimates: noop() : -26.7052 (in 10520 real visits) roll(d3) : -34.5433 (in 9195 real visits) roll(d2) : -25.9165 (in 459713 real visits) roll(d1) : -28.3227 (in 9195 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 4 4 5 | horizon: 65 Setting time for this decision to 2.25316s. THTS: Maximal search depth set to 65 Search time: 2.25316s Statistics of THTS: Performed trials: 509976 Created SearchNodes: 2498745 Cache Hits: 12785 Action Selection: Exploitation in Root: 344785 Exploration in Root: 165191 Percentage Exploration in Root: 0.323919 Skipped backups: 1443901851 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.1115 (in 509980 real visits) Q-Value Estimates: noop() : -22.2072 (in 90345 real visits) roll(d3) : -23.2851 (in 4168 real visits) roll(d2) : -22.1175 (in 207095 real visits) roll(d1) : -22.1115 (in 208372 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 4 5 | horizon: 65 Setting time for this decision to 2.25314s. THTS: Maximal search depth set to 65 Search time: 2.25314s Statistics of THTS: Performed trials: 485035 Created SearchNodes: 2372496 Cache Hits: 13171 Action Selection: Exploitation in Root: 457583 Exploration in Root: 27452 Percentage Exploration in Root: 0.056598 Skipped backups: 1446984053 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -26.9215 (in 485039 real visits) Q-Value Estimates: noop() : -28.5155 (in 9152 real visits) roll(d3) : -36.6995 (in 9152 real visits) roll(d2) : -30.4862 (in 9152 real visits) roll(d1) : -26.9215 (in 457583 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 1 4 5 | horizon: 65 Setting time for this decision to 2.25312s. THTS: Maximal search depth set to 65 Search time: 2.25313s Statistics of THTS: Performed trials: 487656 Created SearchNodes: 2385473 Cache Hits: 13203 Action Selection: Exploitation in Root: 458797 Exploration in Root: 28859 Percentage Exploration in Root: 0.059179 Skipped backups: 1450083885 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9199 (in 487660 real visits) Q-Value Estimates: noop() : -26.6964 (in 10511 real visits) roll(d3) : -34.512 (in 9176 real visits) roll(d2) : -28.3525 (in 9176 real visits) roll(d1) : -25.9199 (in 458797 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 4 5 | horizon: 65 Setting time for this decision to 2.2531s. THTS: Maximal search depth set to 65 Search time: 2.25311s Statistics of THTS: Performed trials: 489711 Created SearchNodes: 2395840 Cache Hits: 13180 Action Selection: Exploitation in Root: 461995 Exploration in Root: 27716 Percentage Exploration in Root: 0.0565966 Skipped backups: 1453199231 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -26.9366 (in 489715 real visits) Q-Value Estimates: noop() : -28.5901 (in 9240 real visits) roll(d3) : -36.9951 (in 9240 real visits) roll(d2) : -30.5726 (in 9240 real visits) roll(d1) : -26.9366 (in 461995 real visits) Used RAM: 483748 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 2.25311s. THTS: Maximal search depth set to 65 Search time: 2.25311s Statistics of THTS: Performed trials: 464194 Created SearchNodes: 2222271 Cache Hits: 24676 Action Selection: Exploitation in Root: 390529 Exploration in Root: 73665 Percentage Exploration in Root: 0.158694 Skipped backups: 1456167985 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.6567 (in 464198 real visits) Q-Value Estimates: noop() : -12.7732 (in 58199 real visits) roll(d3) : -17.5012 (in 7808 real visits) roll(d2) : -12.6567 (in 390383 real visits) roll(d1) : -17.4417 (in 7808 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 2.25309s. THTS: Maximal search depth set to 65 Search time: 2.25309s Statistics of THTS: Performed trials: 456367 Created SearchNodes: 2184656 Cache Hits: 24296 Action Selection: Exploitation in Root: 430541 Exploration in Root: 25826 Percentage Exploration in Root: 0.0565904 Skipped backups: 1459127833 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.6941 (in 456371 real visits) Q-Value Estimates: noop() : -15.9438 (in 8611 real visits) roll(d3) : -24.6838 (in 8611 real visits) roll(d2) : -14.6941 (in 430538 real visits) roll(d1) : -24.6095 (in 8611 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 2.25307s. THTS: Maximal search depth set to 65 Search time: 2.25307s Statistics of THTS: Performed trials: 462898 Created SearchNodes: 2216075 Cache Hits: 24605 Action Selection: Exploitation in Root: 389066 Exploration in Root: 73832 Percentage Exploration in Root: 0.1595 Skipped backups: 1462094977 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.6632 (in 462902 real visits) Q-Value Estimates: noop() : -12.7802 (in 58396 real visits) roll(d3) : -17.2612 (in 7779 real visits) roll(d2) : -12.6632 (in 388948 real visits) roll(d1) : -17.3754 (in 7779 real visits) Used RAM: 483748 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 10 -- REWARD RECEIVED: -133 *********************************************** *********************************************** Immediate rewards: Round 0: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -12 Round 1: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -15 Round 2: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -11 Round 3: -1 -1 -1 -1 -1 -1 -1 -1 -1 = -9 Round 4: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -13 Round 5: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -19 Round 6: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -45 Round 7: -1 -1 -1 -1 -1 -1 -1 = -7 Round 8: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -14 Round 9: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -21 >>> TOTAL REWARD: -1009 >>> AVERAGE REWARD: -100.9 *********************************************** PROST complete running time: 183.123s