/home/linuxbuildslave/buildslaves/ailinux/ipc-prob-build-singularity-linux/build/tmpL_TY34 /home/linuxbuildslave/buildslaves/ailinux/ipc-prob-build-singularity-linux/build/tmpL_TY34 *************** RDDL-PARSER CALL WITH 600SEC *************** Parsing... Setting outcome pruning to 0.5 ...finished (0.00101399s). instantiating... Instantiating variables... ...finished (9.05991e-06) Instantiating CPFs... ...finished (6.29425e-05) Instantiating preconditions... ...finished (5.96046e-06) ...finished (9.01222e-05s). preprocessing... Preparing evaluatables... ...finished (4.19617e-05) Preparing actions... ...finished (1.90735e-05) Calculating CPF domain... ...finished (2.09808e-05) Finalizing evaluatables... ...finished (2.69413e-05) Computing determinization... ...finished (2.7895e-05) Preparing hash keys... ...finished (1.90735e-05) Precomputing evaluatables... ...finished (0.000180006) ...finished (0.000362873s). analyzing task... Creating training set with 215 candidates. ...finished (0.015434s). writing output for instance dice_game_demo_inst_ssp__1... ...finished (0.00209403s). writing transition relations to json file... ...finished (0.000321865s). total time: 0.0193679s RDDL-Parser took: 0.0268092s learning... THTS: learning... DD_Heuristic: learning [31s (0.125%)] with /home/linuxbuildslave/buildslaves/ailinux/ipc-prob-build-singularity-linux/build/tmpL_TY34/dice_game_demo_inst_ssp__1.json... Horizon: 65 Round to dezimal: 2 { "actions": { "noop": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==s0])) * (1 * ([s1_primed==s1])) * (1 * ([s2_primed==s2])))" }, "roll(d1) ": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==0] * (1) + [s0_primed==1] * (1) + [s0_primed==2] * (1) + [s0_primed==3] * (1) + [s0_primed==4] * (1) + [s0_primed==5] * (1))) * (1 * ([s1_primed==s1])) * (1 * ([s2_primed==s2])))" }, "roll(d2) ": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==s0])) * (1 * ([s1_primed==0] * (1) + [s1_primed==1] * (1) + [s1_primed==2] * (1) + [s1_primed==3] * (1) + [s1_primed==4] * (1) + [s1_primed==5] * (1))) * (1 * ([s2_primed==s2])))" }, "roll(d3) ": { "Tc": "(0 - ((([s0 == 0] + ([s0 == 1] * 2) + ([s0 == 2] * 3) + ([s0 == 3] * 4) + ([s0 == 4] * 5) + ([s0 == 5] * 6)) - 6) + (([s1 == 0] + ([s1 == 1] * 2) + ([s1 == 2] * 3) + ([s1 == 3] * 4) + ([s1 == 4] * 5) + ([s1 == 5] * 6)) - 6) + (([s2 == 0] + ([s2 == 1] * 2) + ([s2 == 2] * 3) + ([s2 == 3] * 4) + ([s2 == 4] * 5) + ([s2 == 5] * 6)) - 6)))", "Tr": "((1 * ([s0_primed==s0])) * (1 * ([s1_primed==s1])) * (1 * ([s2_primed==0] * (1) + [s2_primed==1] * (1) + [s2_primed==2] * (1) + [s2_primed==3] * (1) + [s2_primed==4] * (1) + [s2_primed==5] * (1))))" } }, "goal_state": "[[s0 == 5] && [s1 == 5] && [s2 == 5]]", "initial_state": { "s0": 0, "s1": 0, "s2": 0 }, "variables": { "s0": { "domain": 6 }, "s1": { "domain": 6 }, "s2": { "domain": 6 } } } Original ordering: s0 s1 s2 Build ast.....done! Compute fan-in...done! Fan-in ordering: s0 s1 s2 [s0 : 0] [s1 : 1] [s2 : 2] Num variables: 3 => 9 [ incl. primed: 18 ] noop......overall time: 0.05 => Time left: 31.2s roll(d1) ......overall time: 0.07 => Time left: 31.18s roll(d2) ......overall time: 0.08 => Time left: 31.17s roll(d3) ......overall time: 0.1 => Time left: 31.15s Plan step 1... ...overall time: 0.1 => Time left: 31.15s Plan step 2... ...overall time: 0.1 => Time left: 31.15s Plan step 3... ...overall time: 0.1 => Time left: 31.15s Plan step 4... ...overall time: 0.1 => Time left: 31.15s Plan step 5... ...overall time: 0.1 => Time left: 31.15s Plan step 6... ...overall time: 0.1 => Time left: 31.15s Plan step 7... ...overall time: 0.1 => Time left: 31.15s Plan step 8... ...overall time: 0.1 => Time left: 31.15s Plan step 9... ...overall time: 0.1 => Time left: 31.15s Plan step 10... ...overall time: 0.1 => Time left: 31.15s Plan step 11... ...overall time: 0.1 => Time left: 31.15s Plan step 12... ...overall time: 0.1 => Time left: 31.15s Plan step 13... ...overall time: 0.1 => Time left: 31.15s Plan step 14... ...overall time: 0.1 => Time left: 31.15s Plan step 15... ...overall time: 0.11 => Time left: 31.14s Plan step 16... ...overall time: 0.11 => Time left: 31.14s Plan step 17... ...overall time: 0.11 => Time left: 31.14s Plan step 18... ...overall time: 0.11 => Time left: 31.14s Plan step 19... ...overall time: 0.11 => Time left: 31.14s Plan step 20... ...overall time: 0.11 => Time left: 31.14s Plan step 21... ...overall time: 0.11 => Time left: 31.14s Plan step 22... ...overall time: 0.11 => Time left: 31.14s Plan step 23... ...overall time: 0.11 => Time left: 31.14s Plan step 24... ...overall time: 0.11 => Time left: 31.14s Plan step 25... ...overall time: 0.11 => Time left: 31.14s Plan step 26... ...overall time: 0.11 => Time left: 31.14s Plan step 27... ...overall time: 0.11 => Time left: 31.14s State space explored!!! IDS: learning... IDS: Search Depth 2: 0.000113786 / 215 = 5.29237e-07 IDS: Search Depth 3: 0.000352527 / 215 = 1.63966e-06 IDS: Search Depth 4: 0.000604041 / 215 = 2.80949e-06 IDS: Search Depth 5: 0.00085059 / 215 = 3.95623e-06 IDS: Search Depth 6: 0.00108584 / 215 = 5.05043e-06 IDS: Search Depth 7: 0.00132739 / 215 = 6.17393e-06 IDS: Search Depth 8: 0.00156882 / 215 = 7.29685e-06 IDS: Search Depth 9: 0.00181352 / 215 = 8.43496e-06 IDS: Search Depth 10: 0.00205635 / 215 = 9.56441e-06 IDS: Search Depth 11: 0.00229666 / 215 = 1.06821e-05 IDS: Search Depth 12: 0.00254809 / 215 = 1.18516e-05 IDS: Search Depth 13: 0.00278908 / 215 = 1.29725e-05 IDS: Search Depth 14: 0.00302141 / 215 = 1.40531e-05 IDS: Search Depth 15: 0.00324908 / 215 = 1.5112e-05 IDS: Search Depth 16: 0.00348421 / 215 = 1.62056e-05 IDS: Search Depth 17: 0.00372135 / 215 = 1.73086e-05 IDS: Search Depth 18: 0.00396173 / 215 = 1.84267e-05 IDS: Search Depth 19: 0.00420846 / 215 = 1.95742e-05 IDS: Search Depth 20: 0.00444894 / 215 = 2.06927e-05 IDS: Search Depth 21: 0.00469315 / 215 = 2.18286e-05 IDS: Search Depth 22: 0.00495079 / 215 = 2.30269e-05 IDS: Search Depth 23: 0.00518546 / 215 = 2.41184e-05 IDS: Search Depth 24: 0.00542731 / 215 = 2.52433e-05 IDS: Search Depth 25: 0.00568135 / 215 = 2.64249e-05 IDS: Search Depth 26: 0.0059245 / 215 = 2.75558e-05 IDS: Search Depth 27: 0.00617421 / 215 = 2.87173e-05 IDS: Search Depth 28: 0.00640618 / 215 = 2.97962e-05 IDS: Search Depth 29: 0.00664056 / 215 = 3.08863e-05 IDS: Search Depth 30: 0.00688506 / 215 = 3.20235e-05 IDS: Search Depth 31: 0.00715226 / 215 = 3.32663e-05 IDS: Search Depth 32: 0.00738282 / 215 = 3.43387e-05 IDS: Search Depth 33: 0.00763138 / 215 = 3.54948e-05 IDS: Search Depth 34: 0.00786419 / 215 = 3.65776e-05 IDS: Search Depth 35: 0.00812158 / 215 = 3.77748e-05 IDS: Search Depth 36: 0.00837045 / 215 = 3.89323e-05 IDS: Search Depth 37: 0.00861685 / 215 = 4.00784e-05 IDS: Search Depth 38: 0.00886215 / 215 = 4.12193e-05 IDS: Search Depth 39: 0.00910279 / 215 = 4.23386e-05 IDS: Search Depth 40: 0.00933505 / 215 = 4.34188e-05 IDS: Search Depth 41: 0.00959127 / 215 = 4.46105e-05 IDS: Search Depth 42: 0.00982581 / 215 = 4.57014e-05 IDS: Search Depth 43: 0.0100718 / 215 = 4.68457e-05 IDS: Search Depth 44: 0.0103285 / 215 = 4.80397e-05 IDS: Search Depth 45: 0.010567 / 215 = 4.91487e-05 IDS: Search Depth 46: 0.0108198 / 215 = 5.03248e-05 IDS: Search Depth 47: 0.0110821 / 215 = 5.15447e-05 IDS: Search Depth 48: 0.0113194 / 215 = 5.26486e-05 IDS: Search Depth 49: 0.0115654 / 215 = 5.37926e-05 IDS: Search Depth 50: 0.0118061 / 215 = 5.49122e-05 IDS: Search Depth 51: 0.012056 / 215 = 5.60743e-05 IDS: Search Depth 52: 0.0122936 / 215 = 5.71794e-05 IDS: Search Depth 53: 0.012546 / 215 = 5.83535e-05 IDS: Search Depth 54: 0.0127885 / 215 = 5.94816e-05 IDS: Search Depth 55: 0.0130198 / 215 = 6.05573e-05 IDS: Search Depth 56: 0.0132756 / 215 = 6.17472e-05 IDS: Search Depth 57: 0.0135115 / 215 = 6.2844e-05 IDS: Search Depth 58: 0.0137496 / 215 = 6.39514e-05 IDS: Search Depth 59: 0.0139877 / 215 = 6.50589e-05 IDS: Search Depth 60: 0.0142258 / 215 = 6.61663e-05 IDS: Search Depth 61: 0.0144603 / 215 = 6.72572e-05 IDS: Search Depth 62: 0.0146939 / 215 = 6.83435e-05 IDS: Search Depth 63: 0.0149348 / 215 = 6.94644e-05 IDS: Search Depth 64: 0.0151776 / 215 = 7.05933e-05 IDS: Search Depth 65: 0.0154114 / 215 = 7.16809e-05 IDS: Setting max search depth to 65! IDS: ...finished Reset Det Task. ... finished THTS: ...finished ...finished (0.304397s). Final task: ----------------Actions--------------- Action fluents: roll(d1) roll(d2) roll(d3) --------------- Legal Action Combinations: noop() : Index : 0 Relevant preconditions: --------------- roll(d3) : Index : 1 Relevant preconditions: --------------- roll(d2) : Index : 2 Relevant preconditions: --------------- roll(d1) : Index : 3 Relevant preconditions: --------------- -----------------CPFs----------------- die-value(d1) HashIndex: 0, probabilistic, caching in vectors, Kleene caching in vectors of size 126. Action Hash Key Map: roll(d1) : 1 Formula: case roll(d1) then Discrete( [0 : 0.166666666666667] [1 : 0.166666666666667] [2 : 0.166666666666667] [3 : 0.166666666666667] [4 : 0.166666666666667] [5 : 0.166666666666667] ) case 1 then die-value(d1) Determinized formula: case roll(d1) then 0 case 1 then die-value(d1) Domain: @1 @2 @3 @4 @5 @6 HashKeyBase: 0: 0, 1: 1, 2: 2, 3: 3, 4: 4, 5: 5 KleeneHashKeyBase: 1 -------------- die-value(d2) HashIndex: 1, probabilistic, caching in vectors, Kleene caching in vectors of size 126. Action Hash Key Map: roll(d2) : 1 Formula: case roll(d2) then Discrete( [0 : 0.166666666666667] [1 : 0.166666666666667] [2 : 0.166666666666667] [3 : 0.166666666666667] [4 : 0.166666666666667] [5 : 0.166666666666667] ) case 1 then die-value(d2) Determinized formula: case roll(d2) then 0 case 1 then die-value(d2) Domain: @1 @2 @3 @4 @5 @6 HashKeyBase: 0: 0, 1: 6, 2: 12, 3: 18, 4: 24, 5: 30 KleeneHashKeyBase: 63 -------------- die-value(d3) HashIndex: 2, probabilistic, caching in vectors, Kleene caching in vectors of size 126. Action Hash Key Map: roll(d3) : 1 Formula: case roll(d3) then Discrete( [0 : 0.166666666666667] [1 : 0.166666666666667] [2 : 0.166666666666667] [3 : 0.166666666666667] [4 : 0.166666666666667] [5 : 0.166666666666667] ) case 1 then die-value(d3) Determinized formula: case roll(d3) then 0 case 1 then die-value(d3) Domain: @1 @2 @3 @4 @5 @6 HashKeyBase: 0: 0, 1: 36, 2: 72, 3: 108, 4: 144, 5: 180 KleeneHashKeyBase: 3969 -------------- Reward CPF: Reward HashIndex: 3, deterministic, caching in vectors, Kleene caching in maps. Action Hash Key Map: Formula: (+ (- (+ (== die-value(d1) 0) (* (== die-value(d1) 1) 2) (* (== die-value(d1) 2) 3) (* (== die-value(d1) 3) 4) (* (== die-value(d1) 4) 5) (* (== die-value(d1) 5) 6) ) 6) (- (+ (== die-value(d2) 0) (* (== die-value(d2) 1) 2) (* (== die-value(d2) 2) 3) (* (== die-value(d2) 3) 4) (* (== die-value(d2) 4) 5) (* (== die-value(d2) 5) 6) ) 6) (- (+ (== die-value(d3) 0) (* (== die-value(d3) 1) 2) (* (== die-value(d3) 2) 3) (* (== die-value(d3) 3) 4) (* (== die-value(d3) 4) 5) (* (== die-value(d3) 5) 6) ) 6) ) Is action independent: 1 ------State Fluent Hash Key Map------- a change of probabilistic state fluent 0 influences variables 0 (2) 3 (1) 4 (1) a change of probabilistic state fluent 1 influences variables 1 (2) 3 (6) 4 (6) a change of probabilistic state fluent 2 influences variables 2 (2) 3 (36) 4 (36) a change of variable 0 influences variables in Kleene states 0 (2) 3 (1) 4 (1) a change of variable 1 influences variables in Kleene states 1 (2) 3 (63) 4 (63) a change of variable 2 influences variables in Kleene states 2 (2) 3 (3969) 4 (3969) ---------Action Preconditions--------- ----------Initial State--------------- die-value(d1): 0 die-value(d2): 0 die-value(d3): 0 Remaining Steps: 2147483647 StateHashKey: 0 Hashing of States is possible. Hashing of KleeneStates is possible. This task contains unreasonable actions only in the determinization. *********************************************** >>> STARTING ROUND 1 -- REMAINING TIME 249s *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.379408s. THTS: Maximal search depth set to 65 Search time: 0.37941s Statistics of THTS: Performed trials: 108226 Created SearchNodes: 538795 Cache Hits: 580 Action Selection: Exploitation in Root: 56202 Exploration in Root: 52024 Percentage Exploration in Root: 0.480698 Skipped backups: 1266103565 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.5651 (in 108230 real visits) Q-Value Estimates: noop() : -68.2417 (in 726 real visits) roll(d3) : -61.5651 (in 35942 real visits) roll(d2) : -61.567 (in 35962 real visits) roll(d1) : -61.5689 (in 35600 real visits) Used RAM: 281108 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.379407s. THTS: Maximal search depth set to 65 Search time: 0.37941s Statistics of THTS: Performed trials: 103514 Created SearchNodes: 515343 Cache Hits: 558 Action Selection: Exploitation in Root: 55058 Exploration in Root: 48456 Percentage Exploration in Root: 0.468111 Skipped backups: 1266585603 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.5007 (in 103518 real visits) Q-Value Estimates: noop() : -68.1806 (in 738 real visits) roll(d3) : -61.5153 (in 34013 real visits) roll(d2) : -61.5007 (in 34983 real visits) roll(d1) : -61.5168 (in 33784 real visits) Used RAM: 281108 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 0 2 0 | horizon: 65 Setting time for this decision to 0.379406s. THTS: Maximal search depth set to 65 Search time: 0.37941s Statistics of THTS: Performed trials: 100768 Created SearchNodes: 501613 Cache Hits: 557 Action Selection: Exploitation in Root: 56137 Exploration in Root: 44631 Percentage Exploration in Root: 0.442908 Skipped backups: 1267059013 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -54.9371 (in 100772 real visits) Q-Value Estimates: noop() : -59.9708 (in 1019 real visits) roll(d3) : -54.9441 (in 46591 real visits) roll(d2) : -56.6123 (in 5445 real visits) roll(d1) : -54.9371 (in 47717 real visits) Used RAM: 281108 Submitted action: roll(d1) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 2 0 | horizon: 65 Setting time for this decision to 0.379406s. THTS: Maximal search depth set to 65 Search time: 0.37941s Statistics of THTS: Performed trials: 97100 Created SearchNodes: 475577 Cache Hits: 2480 Action Selection: Exploitation in Root: 82132 Exploration in Root: 14968 Percentage Exploration in Root: 0.15415 Skipped backups: 1267527529 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -32.1601 (in 97104 real visits) Q-Value Estimates: noop() : -35.2308 (in 1643 real visits) roll(d3) : -32.1601 (in 82133 real visits) roll(d2) : -32.7905 (in 11685 real visits) roll(d1) : -44.24 (in 1643 real visits) Used RAM: 281108 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 2 1 | horizon: 65 Setting time for this decision to 0.379406s. THTS: Maximal search depth set to 65 Search time: 0.379412s Statistics of THTS: Performed trials: 97903 Created SearchNodes: 479552 Cache Hits: 2492 Action Selection: Exploitation in Root: 69860 Exploration in Root: 28043 Percentage Exploration in Root: 0.286437 Skipped backups: 1267987283 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.9976 (in 97907 real visits) Q-Value Estimates: noop() : -33.1776 (in 1669 real visits) roll(d3) : -30.9976 (in 69859 real visits) roll(d2) : -31.2722 (in 24981 real visits) roll(d1) : -41.9921 (in 1398 real visits) Used RAM: 281108 Submitted action: roll(d3) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 2 1 | horizon: 65 Setting time for this decision to 0.379405s. THTS: Maximal search depth set to 65 Search time: 0.37941s Statistics of THTS: Performed trials: 97820 Created SearchNodes: 478997 Cache Hits: 2527 Action Selection: Exploitation in Root: 70759 Exploration in Root: 27061 Percentage Exploration in Root: 0.276641 Skipped backups: 1268446487 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.9809 (in 97824 real visits) Q-Value Estimates: noop() : -33.206 (in 1612 real visits) roll(d3) : -30.9809 (in 70739 real visits) roll(d2) : -31.2665 (in 24058 real visits) roll(d1) : -41.6134 (in 1415 real visits) Used RAM: 281108 Submitted action: roll(d3) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 0.379404s. THTS: Maximal search depth set to 65 Search time: 0.379409s Statistics of THTS: Performed trials: 90607 Created SearchNodes: 433228 Cache Hits: 4952 Action Selection: Exploitation in Root: 85483 Exploration in Root: 5124 Percentage Exploration in Root: 0.0565519 Skipped backups: 1268924213 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.0697 (in 90611 real visits) Q-Value Estimates: noop() : -15.1045 (in 1710 real visits) roll(d3) : -22.8793 (in 1710 real visits) roll(d2) : -14.0697 (in 85481 real visits) roll(d1) : -22.7082 (in 1710 real visits) Used RAM: 281108 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 3 5 | horizon: 65 Setting time for this decision to 0.379403s. THTS: Maximal search depth set to 65 Search time: 0.379407s Statistics of THTS: Performed trials: 92317 Created SearchNodes: 441214 Cache Hits: 5094 Action Selection: Exploitation in Root: 84149 Exploration in Root: 8168 Percentage Exploration in Root: 0.0884777 Skipped backups: 1269406381 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.0559 (in 92321 real visits) Q-Value Estimates: noop() : -13.5441 (in 4808 real visits) roll(d3) : -19.6498 (in 1683 real visits) roll(d2) : -13.0559 (in 84147 real visits) roll(d1) : -19.5997 (in 1683 real visits) Used RAM: 281108 Submitted action: roll(d2) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 0 5 | horizon: 65 Setting time for this decision to 0.3794s. THTS: Maximal search depth set to 65 Search time: 0.379404s Statistics of THTS: Performed trials: 91877 Created SearchNodes: 439782 Cache Hits: 4901 Action Selection: Exploitation in Root: 86679 Exploration in Root: 5198 Percentage Exploration in Root: 0.0565756 Skipped backups: 1269891995 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.081 (in 91881 real visits) Q-Value Estimates: noop() : -19.1829 (in 1734 real visits) roll(d3) : -27.3909 (in 1734 real visits) roll(d2) : -16.081 (in 86679 real visits) roll(d1) : -27.7057 (in 1734 real visits) Used RAM: 281108 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 0 5 | horizon: 65 Setting time for this decision to 0.379399s. THTS: Maximal search depth set to 65 Search time: 0.379402s Statistics of THTS: Performed trials: 91218 Created SearchNodes: 436459 Cache Hits: 4909 Action Selection: Exploitation in Root: 86056 Exploration in Root: 5162 Percentage Exploration in Root: 0.0565897 Skipped backups: 1270373877 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.0741 (in 91222 real visits) Q-Value Estimates: noop() : -19.2248 (in 1722 real visits) roll(d3) : -27.4944 (in 1722 real visits) roll(d2) : -16.0741 (in 86056 real visits) roll(d1) : -27.7796 (in 1722 real visits) Used RAM: 281108 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.379398s. THTS: Maximal search depth set to 65 Search time: 0.379401s Statistics of THTS: Performed trials: 93491 Created SearchNodes: 447164 Cache Hits: 5074 Action Selection: Exploitation in Root: 74102 Exploration in Root: 19389 Percentage Exploration in Root: 0.207389 Skipped backups: 1270859659 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0006 (in 93495 real visits) Q-Value Estimates: noop() : -12.1657 (in 16645 real visits) roll(d3) : -15.6435 (in 1478 real visits) roll(d2) : -12.0006 (in 73894 real visits) roll(d1) : -15.5542 (in 1478 real visits) Used RAM: 281108 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 1/10 Current state: | 5 1 5 | horizon: 65 Setting time for this decision to 0.379397s. THTS: Maximal search depth set to 65 Search time: 0.379401s Statistics of THTS: Performed trials: 91054 Created SearchNodes: 435691 Cache Hits: 4896 Action Selection: Exploitation in Root: 85901 Exploration in Root: 5153 Percentage Exploration in Root: 0.0565928 Skipped backups: 1271337639 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.0796 (in 91058 real visits) Q-Value Estimates: noop() : -17.0567 (in 1719 real visits) roll(d3) : -25.221 (in 1719 real visits) roll(d2) : -15.0796 (in 85901 real visits) roll(d1) : -25.3454 (in 1719 real visits) Used RAM: 281108 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** >>> END OF ROUND 1 -- REWARD RECEIVED: -85 *********************************************** *********************************************** >>> STARTING ROUND 2 -- REMAINING TIME 245s *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.413769s. THTS: Maximal search depth set to 65 Search time: 0.413773s Statistics of THTS: Performed trials: 109842 Created SearchNodes: 546699 Cache Hits: 629 Action Selection: Exploitation in Root: 51628 Exploration in Root: 58214 Percentage Exploration in Root: 0.529979 Skipped backups: 1271853853 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.6318 (in 109846 real visits) Q-Value Estimates: noop() : -68.15 (in 771 real visits) roll(d3) : -61.6318 (in 36419 real visits) roll(d2) : -61.6324 (in 36394 real visits) roll(d1) : -61.6342 (in 36262 real visits) Used RAM: 281880 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 0 0 5 | horizon: 65 Setting time for this decision to 0.413769s. THTS: Maximal search depth set to 65 Search time: 0.413775s Statistics of THTS: Performed trials: 106982 Created SearchNodes: 523983 Cache Hits: 2733 Action Selection: Exploitation in Root: 72359 Exploration in Root: 34623 Percentage Exploration in Root: 0.323634 Skipped backups: 1272364935 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.4717 (in 106986 real visits) Q-Value Estimates: noop() : -41.4403 (in 1060 real visits) roll(d3) : -51.9611 (in 1060 real visits) roll(d2) : -36.4717 (in 52997 real visits) roll(d1) : -36.4745 (in 51869 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 0 3 5 | horizon: 65 Setting time for this decision to 0.413767s. THTS: Maximal search depth set to 65 Search time: 0.413772s Statistics of THTS: Performed trials: 105485 Created SearchNodes: 516658 Cache Hits: 2693 Action Selection: Exploitation in Root: 97720 Exploration in Root: 7765 Percentage Exploration in Root: 0.0736124 Skipped backups: 1272899799 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -29.3113 (in 105489 real visits) Q-Value Estimates: noop() : -31.4792 (in 1955 real visits) roll(d3) : -40.2056 (in 1955 real visits) roll(d2) : -30.5973 (in 3860 real visits) roll(d1) : -29.3113 (in 97719 real visits) Used RAM: 281880 Submitted action: roll(d1) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 1 3 5 | horizon: 65 Setting time for this decision to 0.413766s. THTS: Maximal search depth set to 65 Search time: 0.413773s Statistics of THTS: Performed trials: 106383 Created SearchNodes: 521016 Cache Hits: 2726 Action Selection: Exploitation in Root: 94653 Exploration in Root: 11730 Percentage Exploration in Root: 0.110262 Skipped backups: 1273430671 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -28.2684 (in 106387 real visits) Q-Value Estimates: noop() : -29.9321 (in 2375 real visits) roll(d3) : -37.6287 (in 1894 real visits) roll(d2) : -29.0793 (in 7466 real visits) roll(d1) : -28.2684 (in 94652 real visits) Used RAM: 281880 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 3 5 | horizon: 65 Setting time for this decision to 0.413764s. THTS: Maximal search depth set to 65 Search time: 0.413769s Statistics of THTS: Performed trials: 100091 Created SearchNodes: 478936 Cache Hits: 5381 Action Selection: Exploitation in Root: 91443 Exploration in Root: 8648 Percentage Exploration in Root: 0.0864014 Skipped backups: 1273958497 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.0848 (in 100095 real visits) Q-Value Estimates: noop() : -13.5745 (in 5003 real visits) roll(d3) : -19.7076 (in 1829 real visits) roll(d2) : -13.0848 (in 91434 real visits) roll(d1) : -19.7165 (in 1829 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 0.413764s. THTS: Maximal search depth set to 65 Search time: 0.413769s Statistics of THTS: Performed trials: 99749 Created SearchNodes: 477062 Cache Hits: 5422 Action Selection: Exploitation in Root: 94105 Exploration in Root: 5644 Percentage Exploration in Root: 0.056582 Skipped backups: 1274489157 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.0864 (in 99753 real visits) Q-Value Estimates: noop() : -15.131 (in 1883 real visits) roll(d3) : -22.932 (in 1883 real visits) roll(d2) : -14.0864 (in 94104 real visits) roll(d1) : -22.9161 (in 1883 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 3 5 | horizon: 65 Setting time for this decision to 0.413763s. THTS: Maximal search depth set to 65 Search time: 0.413769s Statistics of THTS: Performed trials: 100264 Created SearchNodes: 479529 Cache Hits: 5449 Action Selection: Exploitation in Root: 91251 Exploration in Root: 9013 Percentage Exploration in Root: 0.0898927 Skipped backups: 1275015525 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.0826 (in 100268 real visits) Q-Value Estimates: noop() : -13.5462 (in 5367 real visits) roll(d3) : -19.8573 (in 1825 real visits) roll(d2) : -13.0826 (in 91251 real visits) roll(d1) : -19.7913 (in 1825 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 1 5 | horizon: 65 Setting time for this decision to 0.413761s. THTS: Maximal search depth set to 65 Search time: 0.413775s Statistics of THTS: Performed trials: 99948 Created SearchNodes: 477865 Cache Hits: 5470 Action Selection: Exploitation in Root: 94294 Exploration in Root: 5654 Percentage Exploration in Root: 0.0565694 Skipped backups: 1275544881 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.0937 (in 99952 real visits) Q-Value Estimates: noop() : -17.0114 (in 1886 real visits) roll(d3) : -25.2684 (in 1886 real visits) roll(d2) : -15.0937 (in 94294 real visits) roll(d1) : -25.4143 (in 1886 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.413761s. THTS: Maximal search depth set to 65 Search time: 0.413767s Statistics of THTS: Performed trials: 100968 Created SearchNodes: 483213 Cache Hits: 5408 Action Selection: Exploitation in Root: 80526 Exploration in Root: 20442 Percentage Exploration in Root: 0.20246 Skipped backups: 1276078801 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0589 (in 100972 real visits) Q-Value Estimates: noop() : -12.2268 (in 17438 real visits) roll(d3) : -15.4346 (in 1607 real visits) roll(d2) : -12.0589 (in 80320 real visits) roll(d1) : -15.7875 (in 1607 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.41376s. THTS: Maximal search depth set to 65 Search time: 0.413765s Statistics of THTS: Performed trials: 101194 Created SearchNodes: 483959 Cache Hits: 5504 Action Selection: Exploitation in Root: 80419 Exploration in Root: 20775 Percentage Exploration in Root: 0.205299 Skipped backups: 1276611245 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0507 (in 101198 real visits) Q-Value Estimates: noop() : -12.2157 (in 17673 real visits) roll(d3) : -15.6046 (in 1607 real visits) roll(d2) : -12.0507 (in 80311 real visits) roll(d1) : -15.4565 (in 1607 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 0 5 | horizon: 65 Setting time for this decision to 0.413758s. THTS: Maximal search depth set to 65 Search time: 0.413761s Statistics of THTS: Performed trials: 99662 Created SearchNodes: 476523 Cache Hits: 5448 Action Selection: Exploitation in Root: 94023 Exploration in Root: 5639 Percentage Exploration in Root: 0.0565812 Skipped backups: 1277141367 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.0878 (in 99666 real visits) Q-Value Estimates: noop() : -19.2375 (in 1881 real visits) roll(d3) : -27.8761 (in 1881 real visits) roll(d2) : -16.0878 (in 94023 real visits) roll(d1) : -27.9463 (in 1881 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 1 5 | horizon: 65 Setting time for this decision to 0.413758s. THTS: Maximal search depth set to 65 Search time: 0.413761s Statistics of THTS: Performed trials: 99603 Created SearchNodes: 476452 Cache Hits: 5392 Action Selection: Exploitation in Root: 93968 Exploration in Root: 5635 Percentage Exploration in Root: 0.0565746 Skipped backups: 1277669673 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.0894 (in 99607 real visits) Q-Value Estimates: noop() : -17.2537 (in 1880 real visits) roll(d3) : -25.5533 (in 1880 real visits) roll(d2) : -15.0894 (in 93967 real visits) roll(d1) : -25.3652 (in 1880 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 1 5 | horizon: 65 Setting time for this decision to 0.413757s. THTS: Maximal search depth set to 65 Search time: 0.413765s Statistics of THTS: Performed trials: 99826 Created SearchNodes: 477503 Cache Hits: 5408 Action Selection: Exploitation in Root: 94178 Exploration in Root: 5648 Percentage Exploration in Root: 0.0565784 Skipped backups: 1278199769 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.0909 (in 99830 real visits) Q-Value Estimates: noop() : -17.2148 (in 1884 real visits) roll(d3) : -25.5957 (in 1884 real visits) roll(d2) : -15.0909 (in 94178 real visits) roll(d1) : -25.4234 (in 1884 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.413755s. THTS: Maximal search depth set to 65 Search time: 0.413761s Statistics of THTS: Performed trials: 101289 Created SearchNodes: 484602 Cache Hits: 5462 Action Selection: Exploitation in Root: 82409 Exploration in Root: 18880 Percentage Exploration in Root: 0.186397 Skipped backups: 1278734589 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0494 (in 101293 real visits) Q-Value Estimates: noop() : -12.2347 (in 15724 real visits) roll(d3) : -15.785 (in 1646 real visits) roll(d2) : -12.0494 (in 82277 real visits) roll(d1) : -15.7111 (in 1646 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 2/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.413755s. THTS: Maximal search depth set to 65 Search time: 0.413759s Statistics of THTS: Performed trials: 101480 Created SearchNodes: 485933 Cache Hits: 5368 Action Selection: Exploitation in Root: 81398 Exploration in Root: 20082 Percentage Exploration in Root: 0.197891 Skipped backups: 1279272281 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0405 (in 101484 real visits) Q-Value Estimates: noop() : -12.2169 (in 16995 real visits) roll(d3) : -15.5626 (in 1625 real visits) roll(d2) : -12.0405 (in 81239 real visits) roll(d1) : -15.5914 (in 1625 real visits) Used RAM: 281880 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 2 -- REWARD RECEIVED: -66 *********************************************** *********************************************** >>> STARTING ROUND 3 -- REMAINING TIME 238s *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.453537s. THTS: Maximal search depth set to 65 Search time: 0.453563s Statistics of THTS: Performed trials: 121509 Created SearchNodes: 604834 Cache Hits: 679 Action Selection: Exploitation in Root: 61887 Exploration in Root: 59622 Percentage Exploration in Root: 0.49068 Skipped backups: 1279849227 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.7533 (in 121513 real visits) Q-Value Estimates: noop() : -68.3833 (in 811 real visits) roll(d3) : -61.7578 (in 40374 real visits) roll(d2) : -61.7533 (in 40537 real visits) roll(d1) : -61.7632 (in 39791 real visits) Used RAM: 287424 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 0 5 0 | horizon: 65 Setting time for this decision to 0.453536s. THTS: Maximal search depth set to 65 Search time: 0.453538s Statistics of THTS: Performed trials: 115000 Created SearchNodes: 562945 Cache Hits: 3015 Action Selection: Exploitation in Root: 74144 Exploration in Root: 40856 Percentage Exploration in Root: 0.35527 Skipped backups: 1280400561 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.5305 (in 115004 real visits) Q-Value Estimates: noop() : -41.8102 (in 1130 real visits) roll(d3) : -36.5328 (in 56499 real visits) roll(d2) : -51.7144 (in 1130 real visits) roll(d1) : -36.5305 (in 56245 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 2 5 0 | horizon: 65 Setting time for this decision to 0.453535s. THTS: Maximal search depth set to 65 Search time: 0.453543s Statistics of THTS: Performed trials: 114061 Created SearchNodes: 558194 Cache Hits: 3029 Action Selection: Exploitation in Root: 97679 Exploration in Root: 16382 Percentage Exploration in Root: 0.143625 Skipped backups: 1280964623 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -32.3151 (in 114065 real visits) Q-Value Estimates: noop() : -35.3539 (in 1954 real visits) roll(d3) : -32.3151 (in 97677 real visits) roll(d2) : -44.7897 (in 1954 real visits) roll(d1) : -32.9492 (in 12480 real visits) Used RAM: 287424 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 2 5 5 | horizon: 65 Setting time for this decision to 0.453534s. THTS: Maximal search depth set to 65 Search time: 0.453537s Statistics of THTS: Performed trials: 107621 Created SearchNodes: 514478 Cache Hits: 5908 Action Selection: Exploitation in Root: 101534 Exploration in Root: 6087 Percentage Exploration in Root: 0.0565596 Skipped backups: 1281542437 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.1286 (in 107625 real visits) Q-Value Estimates: noop() : -15.2 (in 2031 real visits) roll(d3) : -22.9017 (in 2031 real visits) roll(d2) : -23.2311 (in 2031 real visits) roll(d1) : -14.1286 (in 101532 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.453533s. THTS: Maximal search depth set to 65 Search time: 0.453538s Statistics of THTS: Performed trials: 109669 Created SearchNodes: 524798 Cache Hits: 5888 Action Selection: Exploitation in Root: 88382 Exploration in Root: 21287 Percentage Exploration in Root: 0.194102 Skipped backups: 1282130947 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0743 (in 109673 real visits) Q-Value Estimates: noop() : -12.2446 (in 17855 real visits) roll(d3) : -15.7208 (in 1766 real visits) roll(d2) : -15.6957 (in 1766 real visits) roll(d1) : -12.0743 (in 88286 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 2 5 5 | horizon: 65 Setting time for this decision to 0.45353s. THTS: Maximal search depth set to 65 Search time: 0.453537s Statistics of THTS: Performed trials: 108192 Created SearchNodes: 517617 Cache Hits: 5837 Action Selection: Exploitation in Root: 102077 Exploration in Root: 6115 Percentage Exploration in Root: 0.0565199 Skipped backups: 1282711175 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.1106 (in 108196 real visits) Q-Value Estimates: noop() : -15.2588 (in 2042 real visits) roll(d3) : -23.139 (in 2042 real visits) roll(d2) : -22.8373 (in 2042 real visits) roll(d1) : -14.1106 (in 102070 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 1 5 5 | horizon: 65 Setting time for this decision to 0.453529s. THTS: Maximal search depth set to 65 Search time: 0.453532s Statistics of THTS: Performed trials: 107968 Created SearchNodes: 516801 Cache Hits: 5761 Action Selection: Exploitation in Root: 101858 Exploration in Root: 6110 Percentage Exploration in Root: 0.0565908 Skipped backups: 1283293493 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.13 (in 107972 real visits) Q-Value Estimates: noop() : -17.2881 (in 2038 real visits) roll(d3) : -25.8565 (in 2038 real visits) roll(d2) : -25.6268 (in 2038 real visits) roll(d1) : -15.13 (in 101858 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.453528s. THTS: Maximal search depth set to 65 Search time: 0.453532s Statistics of THTS: Performed trials: 109114 Created SearchNodes: 522255 Cache Hits: 5830 Action Selection: Exploitation in Root: 87134 Exploration in Root: 21980 Percentage Exploration in Root: 0.201441 Skipped backups: 1283880909 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.0876 (in 109118 real visits) Q-Value Estimates: noop() : -12.251 (in 18584 real visits) roll(d3) : -15.7417 (in 1742 real visits) roll(d2) : -15.5555 (in 1741 real visits) roll(d1) : -12.0876 (in 87051 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 3 5 5 | horizon: 65 Setting time for this decision to 0.453527s. THTS: Maximal search depth set to 65 Search time: 0.45353s Statistics of THTS: Performed trials: 108935 Created SearchNodes: 520664 Cache Hits: 6004 Action Selection: Exploitation in Root: 99641 Exploration in Root: 9294 Percentage Exploration in Root: 0.0853169 Skipped backups: 1284461591 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -13.1266 (in 108939 real visits) Q-Value Estimates: noop() : -13.5981 (in 5320 real visits) roll(d3) : -19.8645 (in 1993 real visits) roll(d2) : -19.8674 (in 1993 real visits) roll(d1) : -13.1266 (in 99633 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 2 5 5 | horizon: 65 Setting time for this decision to 0.453526s. THTS: Maximal search depth set to 65 Search time: 0.453531s Statistics of THTS: Performed trials: 108331 Created SearchNodes: 517936 Cache Hits: 5931 Action Selection: Exploitation in Root: 102202 Exploration in Root: 6129 Percentage Exploration in Root: 0.0565766 Skipped backups: 1285044405 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.1332 (in 108335 real visits) Q-Value Estimates: noop() : -15.1674 (in 2044 real visits) roll(d3) : -23.0482 (in 2045 real visits) roll(d2) : -23.0857 (in 2045 real visits) roll(d1) : -14.1332 (in 102201 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 3/10 Current state: | 1 5 5 | horizon: 65 Setting time for this decision to 0.453525s. THTS: Maximal search depth set to 65 Search time: 0.45353s Statistics of THTS: Performed trials: 107660 Created SearchNodes: 515145 Cache Hits: 5790 Action Selection: Exploitation in Root: 101568 Exploration in Root: 6092 Percentage Exploration in Root: 0.0565855 Skipped backups: 1285624111 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.1156 (in 107664 real visits) Q-Value Estimates: noop() : -17.2358 (in 2032 real visits) roll(d3) : -25.5856 (in 2032 real visits) roll(d2) : -25.4559 (in 2032 real visits) roll(d1) : -15.1156 (in 101568 real visits) Used RAM: 287424 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** >>> END OF ROUND 3 -- REWARD RECEIVED: -54 *********************************************** *********************************************** >>> STARTING ROUND 4 -- REMAINING TIME 233s *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.507347s. THTS: Maximal search depth set to 65 Search time: 0.507351s Statistics of THTS: Performed trials: 135497 Created SearchNodes: 674302 Cache Hits: 797 Action Selection: Exploitation in Root: 61987 Exploration in Root: 73510 Percentage Exploration in Root: 0.542521 Skipped backups: 1286278559 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.9372 (in 135501 real visits) Q-Value Estimates: noop() : -68.3676 (in 901 real visits) roll(d3) : -61.9372 (in 45019 real visits) roll(d2) : -61.9446 (in 44799 real visits) roll(d1) : -61.9456 (in 44782 real visits) Used RAM: 293760 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 0 0 2 | horizon: 65 Setting time for this decision to 0.507346s. THTS: Maximal search depth set to 65 Search time: 0.50735s Statistics of THTS: Performed trials: 132670 Created SearchNodes: 660363 Cache Hits: 748 Action Selection: Exploitation in Root: 78463 Exploration in Root: 54207 Percentage Exploration in Root: 0.408585 Skipped backups: 1286926715 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -55.3668 (in 132674 real visits) Q-Value Estimates: noop() : -60.4676 (in 1253 real visits) roll(d3) : -56.9095 (in 6819 real visits) roll(d2) : -55.3704 (in 61992 real visits) roll(d1) : -55.3668 (in 62610 real visits) Used RAM: 293760 Submitted action: roll(d1) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 0 2 | horizon: 65 Setting time for this decision to 0.507344s. THTS: Maximal search depth set to 65 Search time: 0.507349s Statistics of THTS: Performed trials: 132703 Created SearchNodes: 660692 Cache Hits: 707 Action Selection: Exploitation in Root: 94417 Exploration in Root: 38286 Percentage Exploration in Root: 0.288509 Skipped backups: 1287568657 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -50.6741 (in 132707 real visits) Q-Value Estimates: noop() : -54.1713 (in 1889 real visits) roll(d3) : -51.4063 (in 18418 real visits) roll(d2) : -50.6741 (in 94413 real visits) roll(d1) : -51.4205 (in 17987 real visits) Used RAM: 293760 Submitted action: roll(d2) Immediate reward: -11 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 1 2 | horizon: 65 Setting time for this decision to 0.507343s. THTS: Maximal search depth set to 65 Search time: 0.507347s Statistics of THTS: Performed trials: 134891 Created SearchNodes: 671652 Cache Hits: 702 Action Selection: Exploitation in Root: 75438 Exploration in Root: 59453 Percentage Exploration in Root: 0.440748 Skipped backups: 1288197693 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -49.3453 (in 134895 real visits) Q-Value Estimates: noop() : -52.537 (in 2061 real visits) roll(d3) : -49.7461 (in 27656 real visits) roll(d2) : -49.3453 (in 75430 real visits) roll(d1) : -49.7075 (in 29748 real visits) Used RAM: 293760 Submitted action: roll(d2) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 5 2 | horizon: 65 Setting time for this decision to 0.507341s. THTS: Maximal search depth set to 65 Search time: 0.507344s Statistics of THTS: Performed trials: 128145 Created SearchNodes: 627438 Cache Hits: 3323 Action Selection: Exploitation in Root: 89265 Exploration in Root: 38880 Percentage Exploration in Root: 0.303406 Skipped backups: 1288812531 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -29.8258 (in 128149 real visits) Q-Value Estimates: noop() : -31.3977 (in 2728 real visits) roll(d3) : -29.8326 (in 61302 real visits) roll(d2) : -38.9995 (in 1258 real visits) roll(d1) : -29.8258 (in 62861 real visits) Used RAM: 293760 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 1 5 2 | horizon: 65 Setting time for this decision to 0.50734s. THTS: Maximal search depth set to 65 Search time: 0.507345s Statistics of THTS: Performed trials: 127434 Created SearchNodes: 624051 Cache Hits: 3281 Action Selection: Exploitation in Root: 94223 Exploration in Root: 33211 Percentage Exploration in Root: 0.260613 Skipped backups: 1289437967 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -31.2864 (in 127438 real visits) Q-Value Estimates: noop() : -33.3642 (in 1967 real visits) roll(d3) : -31.5637 (in 29366 real visits) roll(d2) : -42.0549 (in 1885 real visits) roll(d1) : -31.2864 (in 94220 real visits) Used RAM: 293760 Submitted action: roll(d1) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 5 2 | horizon: 65 Setting time for this decision to 0.507336s. THTS: Maximal search depth set to 65 Search time: 0.50734s Statistics of THTS: Performed trials: 128408 Created SearchNodes: 628781 Cache Hits: 3316 Action Selection: Exploitation in Root: 87819 Exploration in Root: 40589 Percentage Exploration in Root: 0.316094 Skipped backups: 1290056307 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -29.8672 (in 128412 real visits) Q-Value Estimates: noop() : -31.3907 (in 2842 real visits) roll(d3) : -29.8672 (in 63432 real visits) roll(d2) : -38.6074 (in 1269 real visits) roll(d1) : -29.8809 (in 60869 real visits) Used RAM: 293760 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 2 5 5 | horizon: 65 Setting time for this decision to 0.507335s. THTS: Maximal search depth set to 65 Search time: 0.507339s Statistics of THTS: Performed trials: 119250 Created SearchNodes: 569987 Cache Hits: 6567 Action Selection: Exploitation in Root: 112502 Exploration in Root: 6748 Percentage Exploration in Root: 0.056587 Skipped backups: 1290702655 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.1457 (in 119254 real visits) Q-Value Estimates: noop() : -15.3128 (in 2251 real visits) roll(d3) : -23.1186 (in 2251 real visits) roll(d2) : -22.9717 (in 2251 real visits) roll(d1) : -14.1457 (in 112501 real visits) Used RAM: 293760 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 4/10 Current state: | 0 5 5 | horizon: 65 Setting time for this decision to 0.507333s. THTS: Maximal search depth set to 65 Search time: 0.50734s Statistics of THTS: Performed trials: 119110 Created SearchNodes: 570071 Cache Hits: 6371 Action Selection: Exploitation in Root: 112370 Exploration in Root: 6740 Percentage Exploration in Root: 0.0565863 Skipped backups: 1291353393 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.1697 (in 119114 real visits) Q-Value Estimates: noop() : -19.3011 (in 2248 real visits) roll(d3) : -28.1006 (in 2248 real visits) roll(d2) : -28.2457 (in 2248 real visits) roll(d1) : -16.1697 (in 112370 real visits) Used RAM: 293760 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** >>> END OF ROUND 4 -- REWARD RECEIVED: -76 *********************************************** *********************************************** >>> STARTING ROUND 5 -- REMAINING TIME 229s *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.580179s. THTS: Maximal search depth set to 65 Search time: 0.580183s Statistics of THTS: Performed trials: 151095 Created SearchNodes: 752008 Cache Hits: 868 Action Selection: Exploitation in Root: 73749 Exploration in Root: 77346 Percentage Exploration in Root: 0.511903 Skipped backups: 1292095361 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.1359 (in 151099 real visits) Q-Value Estimates: noop() : -68.9769 (in 1016 real visits) roll(d3) : -62.1359 (in 50767 real visits) roll(d2) : -62.1525 (in 49212 real visits) roll(d1) : -62.1439 (in 50104 real visits) Used RAM: 301152 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 0 0 3 | horizon: 65 Setting time for this decision to 0.580177s. THTS: Maximal search depth set to 65 Search time: 0.580183s Statistics of THTS: Performed trials: 148284 Created SearchNodes: 738309 Cache Hits: 779 Action Selection: Exploitation in Root: 99569 Exploration in Root: 48715 Percentage Exploration in Root: 0.328525 Skipped backups: 1292851373 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -50.9428 (in 148288 real visits) Q-Value Estimates: noop() : -55.3588 (in 1450 real visits) roll(d3) : -54.1245 (in 2111 real visits) roll(d2) : -50.9438 (in 72477 real visits) roll(d1) : -50.9428 (in 72250 real visits) Used RAM: 301152 Submitted action: roll(d1) Immediate reward: -12 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 0 0 3 | horizon: 65 Setting time for this decision to 0.580175s. THTS: Maximal search depth set to 65 Search time: 0.580179s Statistics of THTS: Performed trials: 148074 Created SearchNodes: 737087 Cache Hits: 822 Action Selection: Exploitation in Root: 100487 Exploration in Root: 47587 Percentage Exploration in Root: 0.321373 Skipped backups: 1293604547 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -50.9468 (in 148078 real visits) Q-Value Estimates: noop() : -55.2991 (in 1449 real visits) roll(d3) : -54.3759 (in 1855 real visits) roll(d2) : -50.9473 (in 72404 real visits) roll(d1) : -50.9468 (in 72370 real visits) Used RAM: 301152 Submitted action: roll(d1) Immediate reward: -12 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 0 3 | horizon: 65 Setting time for this decision to 0.580173s. THTS: Maximal search depth set to 65 Search time: 0.580177s Statistics of THTS: Performed trials: 146585 Created SearchNodes: 730170 Cache Hits: 690 Action Selection: Exploitation in Root: 131630 Exploration in Root: 14955 Percentage Exploration in Root: 0.102023 Skipped backups: 1294389473 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -37.8131 (in 146589 real visits) Q-Value Estimates: noop() : -39.6833 (in 3428 real visits) roll(d3) : -38.8367 (in 8900 real visits) roll(d2) : -37.8131 (in 131628 real visits) roll(d1) : -41.5381 (in 2633 real visits) Used RAM: 301152 Submitted action: roll(d2) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 1 3 | horizon: 65 Setting time for this decision to 0.580171s. THTS: Maximal search depth set to 65 Search time: 0.580175s Statistics of THTS: Performed trials: 147614 Created SearchNodes: 735379 Cache Hits: 674 Action Selection: Exploitation in Root: 123089 Exploration in Root: 24525 Percentage Exploration in Root: 0.166143 Skipped backups: 1295162317 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.6969 (in 147618 real visits) Q-Value Estimates: noop() : -38.1485 (in 4911 real visits) roll(d3) : -37.304 (in 17158 real visits) roll(d2) : -36.6969 (in 123087 real visits) roll(d1) : -39.0424 (in 2462 real visits) Used RAM: 301152 Submitted action: roll(d2) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 3 3 | horizon: 65 Setting time for this decision to 0.580171s. THTS: Maximal search depth set to 65 Search time: 0.580174s Statistics of THTS: Performed trials: 150707 Created SearchNodes: 750956 Cache Hits: 646 Action Selection: Exploitation in Root: 93932 Exploration in Root: 56775 Percentage Exploration in Root: 0.376724 Skipped backups: 1295911883 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.7846 (in 150711 real visits) Q-Value Estimates: noop() : -34.4586 (in 10717 real visits) roll(d3) : -33.7846 (in 66691 real visits) roll(d2) : -33.7851 (in 66195 real visits) roll(d1) : -34.7155 (in 7108 real visits) Used RAM: 301152 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 3 5 | horizon: 65 Setting time for this decision to 0.580169s. THTS: Maximal search depth set to 65 Search time: 0.580174s Statistics of THTS: Performed trials: 144864 Created SearchNodes: 710773 Cache Hits: 3388 Action Selection: Exploitation in Root: 115504 Exploration in Root: 29360 Percentage Exploration in Root: 0.202673 Skipped backups: 1296677081 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.4846 (in 144868 real visits) Q-Value Estimates: noop() : -22.8763 (in 15644 real visits) roll(d3) : -26.2978 (in 2310 real visits) roll(d2) : -22.4846 (in 115500 real visits) roll(d1) : -22.9824 (in 11414 real visits) Used RAM: 301152 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 2 5 | horizon: 65 Setting time for this decision to 0.580167s. THTS: Maximal search depth set to 65 Search time: 0.580174s Statistics of THTS: Performed trials: 143470 Created SearchNodes: 703247 Cache Hits: 3527 Action Selection: Exploitation in Root: 129337 Exploration in Root: 14133 Percentage Exploration in Root: 0.0985084 Skipped backups: 1297449935 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.6067 (in 143474 real visits) Q-Value Estimates: noop() : -24.3094 (in 7769 real visits) roll(d3) : -29.6299 (in 2587 real visits) roll(d2) : -23.6067 (in 129337 real visits) roll(d1) : -24.7114 (in 3781 real visits) Used RAM: 301152 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 4 4 5 | horizon: 65 Setting time for this decision to 0.580165s. THTS: Maximal search depth set to 65 Search time: 0.580168s Statistics of THTS: Performed trials: 147470 Created SearchNodes: 724403 Cache Hits: 3238 Action Selection: Exploitation in Root: 93566 Exploration in Root: 53904 Percentage Exploration in Root: 0.365525 Skipped backups: 1298200191 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -20.7626 (in 147474 real visits) Q-Value Estimates: noop() : -20.8715 (in 29048 real visits) roll(d3) : -22.3236 (in 1518 real visits) roll(d2) : -20.7687 (in 57764 real visits) roll(d1) : -20.7626 (in 59144 real visits) Used RAM: 301152 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 0 4 5 | horizon: 65 Setting time for this decision to 0.580165s. THTS: Maximal search depth set to 65 Search time: 0.580171s Statistics of THTS: Performed trials: 142197 Created SearchNodes: 696986 Cache Hits: 3501 Action Selection: Exploitation in Root: 134040 Exploration in Root: 8157 Percentage Exploration in Root: 0.0573641 Skipped backups: 1298979915 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.6586 (in 142201 real visits) Q-Value Estimates: noop() : -27.0902 (in 2801 real visits) roll(d3) : -34.9596 (in 2681 real visits) roll(d2) : -29.1225 (in 2681 real visits) roll(d1) : -25.6586 (in 134038 real visits) Used RAM: 301152 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.580163s. THTS: Maximal search depth set to 65 Search time: 0.58017s Statistics of THTS: Performed trials: 136458 Created SearchNodes: 652231 Cache Hits: 7515 Action Selection: Exploitation in Root: 110828 Exploration in Root: 25630 Percentage Exploration in Root: 0.187823 Skipped backups: 1299727635 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.1364 (in 136462 real visits) Q-Value Estimates: noop() : -12.3052 (in 21334 real visits) roll(d3) : -15.9293 (in 2214 real visits) roll(d2) : -12.1364 (in 110700 real visits) roll(d1) : -15.781 (in 2214 real visits) Used RAM: 301152 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 5 0 5 | horizon: 65 Setting time for this decision to 0.580161s. THTS: Maximal search depth set to 65 Search time: 0.580166s Statistics of THTS: Performed trials: 134498 Created SearchNodes: 642887 Cache Hits: 7402 Action Selection: Exploitation in Root: 126887 Exploration in Root: 7611 Percentage Exploration in Root: 0.0565882 Skipped backups: 1300464367 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.188 (in 134502 real visits) Q-Value Estimates: noop() : -19.3525 (in 2538 real visits) roll(d3) : -28.0793 (in 2538 real visits) roll(d2) : -16.188 (in 126888 real visits) roll(d1) : -28.094 (in 2538 real visits) Used RAM: 301152 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 5/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 0.580151s. THTS: Maximal search depth set to 65 Search time: 0.580155s Statistics of THTS: Performed trials: 136616 Created SearchNodes: 653349 Cache Hits: 7434 Action Selection: Exploitation in Root: 110230 Exploration in Root: 26386 Percentage Exploration in Root: 0.19314 Skipped backups: 1301212513 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.1397 (in 136620 real visits) Q-Value Estimates: noop() : -12.2957 (in 22116 real visits) roll(d3) : -15.8534 (in 2202 real visits) roll(d2) : -12.1397 (in 110100 real visits) roll(d1) : -16.1029 (in 2202 real visits) Used RAM: 301152 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 5 -- REWARD RECEIVED: -81 *********************************************** *********************************************** >>> STARTING ROUND 6 -- REMAINING TIME 221s *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.672972s. THTS: Maximal search depth set to 65 Search time: 0.672976s Statistics of THTS: Performed trials: 174672 Created SearchNodes: 869361 Cache Hits: 1001 Action Selection: Exploitation in Root: 85908 Exploration in Root: 88764 Percentage Exploration in Root: 0.508175 Skipped backups: 1302087733 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.3681 (in 174676 real visits) Q-Value Estimates: noop() : -68.662 (in 1173 real visits) roll(d3) : -62.3715 (in 57579 real visits) roll(d2) : -62.3779 (in 57317 real visits) roll(d1) : -62.3681 (in 58607 real visits) Used RAM: 312236 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.672969s. THTS: Maximal search depth set to 65 Search time: 0.672973s Statistics of THTS: Performed trials: 173500 Created SearchNodes: 863381 Cache Hits: 1031 Action Selection: Exploitation in Root: 91353 Exploration in Root: 82147 Percentage Exploration in Root: 0.47347 Skipped backups: 1302954561 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.3394 (in 173504 real visits) Q-Value Estimates: noop() : -69.1806 (in 1160 real visits) roll(d3) : -62.3394 (in 57955 real visits) roll(d2) : -62.3464 (in 57341 real visits) roll(d1) : -62.3483 (in 57048 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 0 4 | horizon: 65 Setting time for this decision to 0.672969s. THTS: Maximal search depth set to 65 Search time: 0.672973s Statistics of THTS: Performed trials: 168458 Created SearchNodes: 838727 Cache Hits: 892 Action Selection: Exploitation in Root: 108905 Exploration in Root: 59553 Percentage Exploration in Root: 0.353518 Skipped backups: 1303844101 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -45.1079 (in 168462 real visits) Q-Value Estimates: noop() : -49.2921 (in 1658 real visits) roll(d3) : -52.8398 (in 1658 real visits) roll(d2) : -45.1079 (in 82875 real visits) roll(d1) : -45.1233 (in 82271 real visits) Used RAM: 312236 Submitted action: roll(d2) Immediate reward: -11 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 0 3 4 | horizon: 65 Setting time for this decision to 0.672966s. THTS: Maximal search depth set to 65 Search time: 0.672968s Statistics of THTS: Performed trials: 168150 Created SearchNodes: 837323 Cache Hits: 858 Action Selection: Exploitation in Root: 150961 Exploration in Root: 17189 Percentage Exploration in Root: 0.102224 Skipped backups: 1304758441 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -38.0464 (in 168154 real visits) Q-Value Estimates: noop() : -39.9491 (in 3512 real visits) roll(d3) : -41.3363 (in 3020 real visits) roll(d2) : -38.9926 (in 10661 real visits) roll(d1) : -38.0464 (in 150961 real visits) Used RAM: 312236 Submitted action: roll(d1) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 1 3 4 | horizon: 65 Setting time for this decision to 0.672966s. THTS: Maximal search depth set to 65 Search time: 0.674123s Statistics of THTS: Performed trials: 168834 Created SearchNodes: 840919 Cache Hits: 814 Action Selection: Exploitation in Root: 141070 Exploration in Root: 27764 Percentage Exploration in Root: 0.164446 Skipped backups: 1305661563 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.9364 (in 168838 real visits) Q-Value Estimates: noop() : -38.3622 (in 5319 real visits) roll(d3) : -39.3074 (in 2822 real visits) roll(d2) : -37.5138 (in 19627 real visits) roll(d1) : -36.9364 (in 141070 real visits) Used RAM: 312236 Submitted action: roll(d1) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 3 4 | horizon: 65 Setting time for this decision to 0.672959s. THTS: Maximal search depth set to 65 Search time: 0.672962s Statistics of THTS: Performed trials: 172442 Created SearchNodes: 859271 Cache Hits: 736 Action Selection: Exploitation in Root: 103554 Exploration in Root: 68888 Percentage Exploration in Root: 0.399485 Skipped backups: 1306537711 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.0133 (in 172446 real visits) Q-Value Estimates: noop() : -34.7022 (in 11545 real visits) roll(d3) : -34.9221 (in 7904 real visits) roll(d2) : -34.0133 (in 75569 real visits) roll(d1) : -34.0178 (in 77428 real visits) Used RAM: 312236 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 1 4 | horizon: 65 Setting time for this decision to 0.672956s. THTS: Maximal search depth set to 65 Search time: 0.672961s Statistics of THTS: Performed trials: 169044 Created SearchNodes: 842001 Cache Hits: 806 Action Selection: Exploitation in Root: 142531 Exploration in Root: 26513 Percentage Exploration in Root: 0.156841 Skipped backups: 1307441391 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.9384 (in 169048 real visits) Q-Value Estimates: noop() : -38.389 (in 5127 real visits) roll(d3) : -39.0692 (in 2851 real visits) roll(d2) : -36.9384 (in 142530 real visits) roll(d1) : -37.5406 (in 18540 real visits) Used RAM: 312236 Submitted action: roll(d2) Immediate reward: -7 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 3 4 | horizon: 65 Setting time for this decision to 0.672956s. THTS: Maximal search depth set to 65 Search time: 0.67296s Statistics of THTS: Performed trials: 172122 Created SearchNodes: 857671 Cache Hits: 736 Action Selection: Exploitation in Root: 104448 Exploration in Root: 67674 Percentage Exploration in Root: 0.393175 Skipped backups: 1308313193 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.0028 (in 172126 real visits) Q-Value Estimates: noop() : -34.6948 (in 11297 real visits) roll(d3) : -34.8951 (in 8121 real visits) roll(d2) : -34.0028 (in 76705 real visits) roll(d1) : -34.0041 (in 76003 real visits) Used RAM: 312236 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 3 3 4 | horizon: 65 Setting time for this decision to 0.672953s. THTS: Maximal search depth set to 65 Search time: 0.672955s Statistics of THTS: Performed trials: 172106 Created SearchNodes: 857515 Cache Hits: 755 Action Selection: Exploitation in Root: 107029 Exploration in Root: 65077 Percentage Exploration in Root: 0.378122 Skipped backups: 1309183531 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.9937 (in 172110 real visits) Q-Value Estimates: noop() : -34.6725 (in 11585 real visits) roll(d3) : -34.8809 (in 8083 real visits) roll(d2) : -33.9978 (in 75547 real visits) roll(d1) : -33.9937 (in 76895 real visits) Used RAM: 312236 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 3 4 | horizon: 65 Setting time for this decision to 0.672953s. THTS: Maximal search depth set to 65 Search time: 0.672957s Statistics of THTS: Performed trials: 172591 Created SearchNodes: 860400 Cache Hits: 640 Action Selection: Exploitation in Root: 115205 Exploration in Root: 57386 Percentage Exploration in Root: 0.332497 Skipped backups: 1310077449 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.3393 (in 172595 real visits) Q-Value Estimates: noop() : -30.7958 (in 19004 real visits) roll(d3) : -30.8026 (in 18601 real visits) roll(d2) : -30.3393 (in 115195 real visits) roll(d1) : -30.778 (in 19795 real visits) Used RAM: 312236 Submitted action: roll(d2) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.672949s. THTS: Maximal search depth set to 65 Search time: 0.672953s Statistics of THTS: Performed trials: 166380 Created SearchNodes: 817189 Cache Hits: 3679 Action Selection: Exploitation in Root: 106290 Exploration in Root: 60090 Percentage Exploration in Root: 0.361161 Skipped backups: 1310934039 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -20.8724 (in 166384 real visits) Q-Value Estimates: noop() : -21.002 (in 31957 real visits) roll(d3) : -20.8724 (in 67025 real visits) roll(d2) : -22.2565 (in 1898 real visits) roll(d1) : -20.8787 (in 65504 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.672949s. THTS: Maximal search depth set to 65 Search time: 0.672952s Statistics of THTS: Performed trials: 162303 Created SearchNodes: 795572 Cache Hits: 3987 Action Selection: Exploitation in Root: 151286 Exploration in Root: 11017 Percentage Exploration in Root: 0.0678792 Skipped backups: 1311831669 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.7592 (in 162307 real visits) Q-Value Estimates: noop() : -25.7823 (in 4969 real visits) roll(d3) : -24.7592 (in 151286 real visits) roll(d2) : -32.8863 (in 3026 real visits) roll(d1) : -26.8569 (in 3026 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.672946s. THTS: Maximal search depth set to 65 Search time: 0.672948s Statistics of THTS: Performed trials: 161962 Created SearchNodes: 793783 Cache Hits: 4008 Action Selection: Exploitation in Root: 151001 Exploration in Root: 10961 Percentage Exploration in Root: 0.0676764 Skipped backups: 1312730651 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.7813 (in 161966 real visits) Q-Value Estimates: noop() : -25.7849 (in 4927 real visits) roll(d3) : -24.7813 (in 150999 real visits) roll(d2) : -32.7453 (in 3020 real visits) roll(d1) : -27.1096 (in 3020 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 2 | horizon: 65 Setting time for this decision to 0.672942s. THTS: Maximal search depth set to 65 Search time: 0.672948s Statistics of THTS: Performed trials: 162941 Created SearchNodes: 798918 Cache Hits: 3948 Action Selection: Exploitation in Root: 147243 Exploration in Root: 15698 Percentage Exploration in Root: 0.0963416 Skipped backups: 1313629783 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.7444 (in 162945 real visits) Q-Value Estimates: noop() : -24.4115 (in 8693 real visits) roll(d3) : -23.7444 (in 147239 real visits) roll(d2) : -30.1431 (in 2945 real visits) roll(d1) : -24.8214 (in 4068 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 3 | horizon: 65 Setting time for this decision to 0.672942s. THTS: Maximal search depth set to 65 Search time: 0.672946s Statistics of THTS: Performed trials: 165075 Created SearchNodes: 809868 Cache Hits: 3878 Action Selection: Exploitation in Root: 132258 Exploration in Root: 32817 Percentage Exploration in Root: 0.198801 Skipped backups: 1314517683 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.6286 (in 165079 real visits) Q-Value Estimates: noop() : -23.0156 (in 16994 real visits) roll(d3) : -22.6286 (in 132256 real visits) roll(d2) : -26.5727 (in 2646 real visits) roll(d1) : -23.0975 (in 13183 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.672939s. THTS: Maximal search depth set to 65 Search time: 0.672945s Statistics of THTS: Performed trials: 162004 Created SearchNodes: 793985 Cache Hits: 4010 Action Selection: Exploitation in Root: 152839 Exploration in Root: 9165 Percentage Exploration in Root: 0.0565727 Skipped backups: 1315420289 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.8099 (in 162008 real visits) Q-Value Estimates: noop() : -27.3194 (in 3057 real visits) roll(d3) : -25.8099 (in 152837 real visits) roll(d2) : -34.7986 (in 3057 real visits) roll(d1) : -29.2021 (in 3057 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.672939s. THTS: Maximal search depth set to 65 Search time: 0.672941s Statistics of THTS: Performed trials: 162087 Created SearchNodes: 794500 Cache Hits: 3985 Action Selection: Exploitation in Root: 151254 Exploration in Root: 10833 Percentage Exploration in Root: 0.0668345 Skipped backups: 1316320201 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.7722 (in 162091 real visits) Q-Value Estimates: noop() : -25.7971 (in 4785 real visits) roll(d3) : -24.7722 (in 151254 real visits) roll(d2) : -32.707 (in 3026 real visits) roll(d1) : -27.0386 (in 3026 real visits) Used RAM: 312236 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 4 5 5 | horizon: 65 Setting time for this decision to 0.672935s. THTS: Maximal search depth set to 65 Search time: 0.67294s Statistics of THTS: Performed trials: 154906 Created SearchNodes: 740463 Cache Hits: 8518 Action Selection: Exploitation in Root: 125549 Exploration in Root: 29357 Percentage Exploration in Root: 0.189515 Skipped backups: 1317177341 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.1901 (in 154910 real visits) Q-Value Estimates: noop() : -12.3443 (in 24560 real visits) roll(d3) : -16.155 (in 2507 real visits) roll(d2) : -16.1667 (in 2507 real visits) roll(d1) : -12.1901 (in 125336 real visits) Used RAM: 312236 Submitted action: roll(d1) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 6/10 Current state: | 2 5 5 | horizon: 65 Setting time for this decision to 0.672935s. THTS: Maximal search depth set to 65 Search time: 0.672939s Statistics of THTS: Performed trials: 153690 Created SearchNodes: 734751 Cache Hits: 8426 Action Selection: Exploitation in Root: 144995 Exploration in Root: 8695 Percentage Exploration in Root: 0.0565749 Skipped backups: 1318035933 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.2508 (in 153694 real visits) Q-Value Estimates: noop() : -15.2669 (in 2900 real visits) roll(d3) : -23.3758 (in 2900 real visits) roll(d2) : -23.4495 (in 2900 real visits) roll(d1) : -14.2508 (in 144994 real visits) Used RAM: 312236 Submitted action: roll(d1) Immediate reward: -3 *********************************************** *********************************************** >>> END OF ROUND 6 -- REWARD RECEIVED: -116 *********************************************** *********************************************** >>> STARTING ROUND 7 -- REMAINING TIME 208s *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.791988s. THTS: Maximal search depth set to 65 Search time: 0.791991s Statistics of THTS: Performed trials: 202102 Created SearchNodes: 1005443 Cache Hits: 1268 Action Selection: Exploitation in Root: 95453 Exploration in Root: 106649 Percentage Exploration in Root: 0.527699 Skipped backups: 1319064589 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.6039 (in 202106 real visits) Q-Value Estimates: noop() : -69.5231 (in 1347 real visits) roll(d3) : -62.6113 (in 66130 real visits) roll(d2) : -62.6047 (in 67297 real visits) roll(d1) : -62.6039 (in 67332 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 0 | horizon: 65 Setting time for this decision to 0.791985s. THTS: Maximal search depth set to 65 Search time: 0.791987s Statistics of THTS: Performed trials: 198616 Created SearchNodes: 988349 Cache Hits: 1184 Action Selection: Exploitation in Root: 129768 Exploration in Root: 68848 Percentage Exploration in Root: 0.346639 Skipped backups: 1320092303 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.1041 (in 198620 real visits) Q-Value Estimates: noop() : -61.0556 (in 1888 real visits) roll(d3) : -56.1186 (in 93602 real visits) roll(d2) : -56.1041 (in 94371 real visits) roll(d1) : -57.5866 (in 8759 real visits) Used RAM: 325172 Submitted action: roll(d2) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 0 | horizon: 65 Setting time for this decision to 0.791984s. THTS: Maximal search depth set to 65 Search time: 0.791987s Statistics of THTS: Performed trials: 198100 Created SearchNodes: 985513 Cache Hits: 1248 Action Selection: Exploitation in Root: 131926 Exploration in Root: 66174 Percentage Exploration in Root: 0.334043 Skipped backups: 1321115425 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.1354 (in 198104 real visits) Q-Value Estimates: noop() : -61.6157 (in 1878 real visits) roll(d3) : -56.1376 (in 93220 real visits) roll(d2) : -56.1354 (in 93865 real visits) roll(d1) : -57.547 (in 9141 real visits) Used RAM: 325172 Submitted action: roll(d2) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 0 | horizon: 65 Setting time for this decision to 0.791981s. THTS: Maximal search depth set to 65 Search time: 0.791986s Statistics of THTS: Performed trials: 198157 Created SearchNodes: 985882 Cache Hits: 1227 Action Selection: Exploitation in Root: 109036 Exploration in Root: 89121 Percentage Exploration in Root: 0.449749 Skipped backups: 1322140997 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.0794 (in 198161 real visits) Q-Value Estimates: noop() : -61.4981 (in 1880 real visits) roll(d3) : -56.0794 (in 93993 real visits) roll(d2) : -56.0841 (in 93093 real visits) roll(d1) : -57.4836 (in 9195 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 0 4 | horizon: 65 Setting time for this decision to 0.79198s. THTS: Maximal search depth set to 65 Search time: 0.791984s Statistics of THTS: Performed trials: 193597 Created SearchNodes: 963934 Cache Hits: 1014 Action Selection: Exploitation in Root: 154990 Exploration in Root: 38607 Percentage Exploration in Root: 0.199419 Skipped backups: 1323192755 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -41.1798 (in 193601 real visits) Q-Value Estimates: noop() : -43.4104 (in 3100 real visits) roll(d3) : -46.4441 (in 3100 real visits) roll(d2) : -41.1798 (in 154991 real visits) roll(d1) : -41.6164 (in 32410 real visits) Used RAM: 325172 Submitted action: roll(d2) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.791976s. THTS: Maximal search depth set to 65 Search time: 0.791982s Statistics of THTS: Performed trials: 187393 Created SearchNodes: 918262 Cache Hits: 4677 Action Selection: Exploitation in Root: 169609 Exploration in Root: 17784 Percentage Exploration in Root: 0.0949022 Skipped backups: 1324243367 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.882 (in 187397 real visits) Q-Value Estimates: noop() : -24.5193 (in 9935 real visits) roll(d3) : -24.9271 (in 4463 real visits) roll(d2) : -30.192 (in 3393 real visits) roll(d1) : -23.882 (in 169606 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791972s. THTS: Maximal search depth set to 65 Search time: 0.791975s Statistics of THTS: Performed trials: 185818 Created SearchNodes: 910747 Cache Hits: 4587 Action Selection: Exploitation in Root: 173561 Exploration in Root: 12257 Percentage Exploration in Root: 0.0659624 Skipped backups: 1325292047 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9132 (in 185822 real visits) Q-Value Estimates: noop() : -25.8995 (in 5317 real visits) roll(d3) : -27.0649 (in 3472 real visits) roll(d2) : -32.8337 (in 3472 real visits) roll(d1) : -24.9132 (in 173561 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791972s. THTS: Maximal search depth set to 65 Search time: 0.791976s Statistics of THTS: Performed trials: 187168 Created SearchNodes: 917161 Cache Hits: 4671 Action Selection: Exploitation in Root: 175151 Exploration in Root: 12017 Percentage Exploration in Root: 0.0642044 Skipped backups: 1326350817 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9235 (in 187172 real visits) Q-Value Estimates: noop() : -25.9474 (in 5015 real visits) roll(d3) : -27.164 (in 3503 real visits) roll(d2) : -33.161 (in 3503 real visits) roll(d1) : -24.9235 (in 175151 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791968s. THTS: Maximal search depth set to 65 Search time: 0.791972s Statistics of THTS: Performed trials: 194774 Created SearchNodes: 956223 Cache Hits: 4413 Action Selection: Exploitation in Root: 113394 Exploration in Root: 81380 Percentage Exploration in Root: 0.417818 Skipped backups: 1327379429 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.057 (in 194778 real visits) Q-Value Estimates: noop() : -21.1824 (in 36370 real visits) roll(d3) : -21.057 (in 78583 real visits) roll(d2) : -22.3625 (in 2204 real visits) roll(d1) : -21.0609 (in 77621 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 2 | horizon: 65 Setting time for this decision to 0.791968s. THTS: Maximal search depth set to 65 Search time: 0.791971s Statistics of THTS: Performed trials: 188042 Created SearchNodes: 921483 Cache Hits: 4683 Action Selection: Exploitation in Root: 170897 Exploration in Root: 17145 Percentage Exploration in Root: 0.0911764 Skipped backups: 1328435351 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.9106 (in 188046 real visits) Q-Value Estimates: noop() : -24.569 (in 9392 real visits) roll(d3) : -23.9106 (in 170895 real visits) roll(d2) : -30.2073 (in 3418 real visits) roll(d1) : -24.9739 (in 4341 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 2 | horizon: 65 Setting time for this decision to 0.791964s. THTS: Maximal search depth set to 65 Search time: 0.791966s Statistics of THTS: Performed trials: 188817 Created SearchNodes: 925298 Cache Hits: 4698 Action Selection: Exploitation in Root: 171334 Exploration in Root: 17483 Percentage Exploration in Root: 0.0925923 Skipped backups: 1329494255 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.8946 (in 188821 real visits) Q-Value Estimates: noop() : -24.5556 (in 9598 real visits) roll(d3) : -23.8946 (in 171332 real visits) roll(d2) : -30.2751 (in 3427 real visits) roll(d1) : -24.9437 (in 4464 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.791964s. THTS: Maximal search depth set to 65 Search time: 0.791969s Statistics of THTS: Performed trials: 187320 Created SearchNodes: 917761 Cache Hits: 4711 Action Selection: Exploitation in Root: 174704 Exploration in Root: 12616 Percentage Exploration in Root: 0.06735 Skipped backups: 1330553945 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9326 (in 187324 real visits) Q-Value Estimates: noop() : -25.8883 (in 5631 real visits) roll(d3) : -24.9326 (in 174703 real visits) roll(d2) : -32.9744 (in 3495 real visits) roll(d1) : -27.5057 (in 3495 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 3 | horizon: 65 Setting time for this decision to 0.79196s. THTS: Maximal search depth set to 65 Search time: 0.791962s Statistics of THTS: Performed trials: 189975 Created SearchNodes: 931452 Cache Hits: 4607 Action Selection: Exploitation in Root: 151339 Exploration in Root: 38636 Percentage Exploration in Root: 0.203374 Skipped backups: 1331592199 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.7676 (in 189979 real visits) Q-Value Estimates: noop() : -23.1322 (in 20006 real visits) roll(d3) : -22.7676 (in 151322 real visits) roll(d2) : -26.8312 (in 3027 real visits) roll(d1) : -23.2089 (in 15624 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.79196s. THTS: Maximal search depth set to 65 Search time: 0.791975s Statistics of THTS: Performed trials: 193602 Created SearchNodes: 950359 Cache Hits: 4414 Action Selection: Exploitation in Root: 117673 Exploration in Root: 75929 Percentage Exploration in Root: 0.392191 Skipped backups: 1332612355 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0354 (in 193606 real visits) Q-Value Estimates: noop() : -21.1539 (in 37396 real visits) roll(d3) : -21.0354 (in 77587 real visits) roll(d2) : -22.3296 (in 2236 real visits) roll(d1) : -21.04 (in 76387 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791955s. THTS: Maximal search depth set to 65 Search time: 0.79196s Statistics of THTS: Performed trials: 194088 Created SearchNodes: 952961 Cache Hits: 4371 Action Selection: Exploitation in Root: 122951 Exploration in Root: 71137 Percentage Exploration in Root: 0.366519 Skipped backups: 1333637473 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0558 (in 194092 real visits) Q-Value Estimates: noop() : -21.1803 (in 37910 real visits) roll(d3) : -21.0686 (in 76969 real visits) roll(d2) : -22.3878 (in 2152 real visits) roll(d1) : -21.0558 (in 77061 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791951s. THTS: Maximal search depth set to 65 Search time: 0.791954s Statistics of THTS: Performed trials: 186829 Created SearchNodes: 915406 Cache Hits: 4686 Action Selection: Exploitation in Root: 174203 Exploration in Root: 12626 Percentage Exploration in Root: 0.0675805 Skipped backups: 1334691859 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9342 (in 186833 real visits) Q-Value Estimates: noop() : -25.8896 (in 5660 real visits) roll(d3) : -27.1071 (in 3485 real visits) roll(d2) : -33.0078 (in 3485 real visits) roll(d1) : -24.9342 (in 174203 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.791951s. THTS: Maximal search depth set to 65 Search time: 0.791956s Statistics of THTS: Performed trials: 188072 Created SearchNodes: 921713 Cache Hits: 4663 Action Selection: Exploitation in Root: 170689 Exploration in Root: 17383 Percentage Exploration in Root: 0.0924274 Skipped backups: 1335745973 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.9046 (in 188076 real visits) Q-Value Estimates: noop() : -24.5634 (in 9448 real visits) roll(d3) : -24.9456 (in 4526 real visits) roll(d2) : -30.2798 (in 3414 real visits) roll(d1) : -23.9046 (in 170688 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791947s. THTS: Maximal search depth set to 65 Search time: 0.79195s Statistics of THTS: Performed trials: 186170 Created SearchNodes: 912327 Cache Hits: 4632 Action Selection: Exploitation in Root: 174100 Exploration in Root: 12070 Percentage Exploration in Root: 0.0648332 Skipped backups: 1336800213 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9333 (in 186174 real visits) Q-Value Estimates: noop() : -25.9573 (in 5111 real visits) roll(d3) : -27.2836 (in 3482 real visits) roll(d2) : -32.7193 (in 3482 real visits) roll(d1) : -24.9333 (in 174099 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791946s. THTS: Maximal search depth set to 65 Search time: 0.791951s Statistics of THTS: Performed trials: 194244 Created SearchNodes: 953661 Cache Hits: 4391 Action Selection: Exploitation in Root: 122351 Exploration in Root: 71893 Percentage Exploration in Root: 0.370117 Skipped backups: 1337826471 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0547 (in 194248 real visits) Q-Value Estimates: noop() : -21.1806 (in 37113 real visits) roll(d3) : -21.0547 (in 77198 real visits) roll(d2) : -22.3866 (in 2171 real visits) roll(d1) : -21.0623 (in 77766 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.791942s. THTS: Maximal search depth set to 65 Search time: 0.791944s Statistics of THTS: Performed trials: 186327 Created SearchNodes: 912664 Cache Hits: 4744 Action Selection: Exploitation in Root: 175783 Exploration in Root: 10544 Percentage Exploration in Root: 0.0565887 Skipped backups: 1338878713 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9319 (in 186331 real visits) Q-Value Estimates: noop() : -27.377 (in 3516 real visits) roll(d3) : -25.9319 (in 175783 real visits) roll(d2) : -35.1417 (in 3516 real visits) roll(d1) : -29.7039 (in 3516 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.791942s. THTS: Maximal search depth set to 65 Search time: 0.791946s Statistics of THTS: Performed trials: 187220 Created SearchNodes: 917409 Cache Hits: 4674 Action Selection: Exploitation in Root: 174837 Exploration in Root: 12383 Percentage Exploration in Root: 0.0661414 Skipped backups: 1339939099 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9351 (in 187224 real visits) Q-Value Estimates: noop() : -25.9143 (in 5393 real visits) roll(d3) : -24.9351 (in 174837 real visits) roll(d2) : -32.8669 (in 3497 real visits) roll(d1) : -27.2829 (in 3497 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.791937s. THTS: Maximal search depth set to 65 Search time: 0.79194s Statistics of THTS: Performed trials: 187429 Created SearchNodes: 918394 Cache Hits: 4689 Action Selection: Exploitation in Root: 175040 Exploration in Root: 12389 Percentage Exploration in Root: 0.0660997 Skipped backups: 1340997525 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9226 (in 187433 real visits) Q-Value Estimates: noop() : -25.9042 (in 5391 real visits) roll(d3) : -24.9226 (in 175040 real visits) roll(d2) : -32.8829 (in 3501 real visits) roll(d1) : -27.2927 (in 3501 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.791933s. THTS: Maximal search depth set to 65 Search time: 0.791935s Statistics of THTS: Performed trials: 187216 Created SearchNodes: 917245 Cache Hits: 4710 Action Selection: Exploitation in Root: 176622 Exploration in Root: 10594 Percentage Exploration in Root: 0.056587 Skipped backups: 1342054551 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9411 (in 187220 real visits) Q-Value Estimates: noop() : -27.6045 (in 3533 real visits) roll(d3) : -25.9411 (in 176621 real visits) roll(d2) : -35.2301 (in 3533 real visits) roll(d1) : -29.4394 (in 3533 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.791932s. THTS: Maximal search depth set to 65 Search time: 0.791936s Statistics of THTS: Performed trials: 187379 Created SearchNodes: 917804 Cache Hits: 4774 Action Selection: Exploitation in Root: 176775 Exploration in Root: 10604 Percentage Exploration in Root: 0.0565912 Skipped backups: 1343115739 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.935 (in 187383 real visits) Q-Value Estimates: noop() : -27.616 (in 3536 real visits) roll(d3) : -25.935 (in 176775 real visits) roll(d2) : -35.1613 (in 3536 real visits) roll(d1) : -29.4719 (in 3536 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.791932s. THTS: Maximal search depth set to 65 Search time: 0.791938s Statistics of THTS: Performed trials: 187669 Created SearchNodes: 919510 Cache Hits: 4710 Action Selection: Exploitation in Root: 175603 Exploration in Root: 12066 Percentage Exploration in Root: 0.064294 Skipped backups: 1344178243 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9181 (in 187673 real visits) Q-Value Estimates: noop() : -25.9434 (in 5046 real visits) roll(d3) : -24.9181 (in 175601 real visits) roll(d2) : -32.8133 (in 3513 real visits) roll(d1) : -27.1767 (in 3513 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 2 | horizon: 65 Setting time for this decision to 0.791928s. THTS: Maximal search depth set to 65 Search time: 0.791932s Statistics of THTS: Performed trials: 188491 Created SearchNodes: 923572 Cache Hits: 4722 Action Selection: Exploitation in Root: 170359 Exploration in Root: 18132 Percentage Exploration in Root: 0.0961956 Skipped backups: 1345235533 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.8973 (in 188495 real visits) Q-Value Estimates: noop() : -24.5114 (in 10498 real visits) roll(d3) : -23.8973 (in 170343 real visits) roll(d2) : -30.0573 (in 3407 real visits) roll(d1) : -24.9789 (in 4247 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.791923s. THTS: Maximal search depth set to 65 Search time: 0.791929s Statistics of THTS: Performed trials: 187538 Created SearchNodes: 918655 Cache Hits: 4760 Action Selection: Exploitation in Root: 175101 Exploration in Root: 12437 Percentage Exploration in Root: 0.0663172 Skipped backups: 1346295083 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9286 (in 187542 real visits) Q-Value Estimates: noop() : -25.9204 (in 5437 real visits) roll(d3) : -24.9286 (in 175101 real visits) roll(d2) : -32.7573 (in 3502 real visits) roll(d1) : -27.2714 (in 3502 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791923s. THTS: Maximal search depth set to 65 Search time: 0.791927s Statistics of THTS: Performed trials: 194246 Created SearchNodes: 953707 Cache Hits: 4382 Action Selection: Exploitation in Root: 128414 Exploration in Root: 65832 Percentage Exploration in Root: 0.33891 Skipped backups: 1347322997 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0602 (in 194250 real visits) Q-Value Estimates: noop() : -21.1776 (in 37970 real visits) roll(d3) : -21.0602 (in 76656 real visits) roll(d2) : -22.3198 (in 2334 real visits) roll(d1) : -21.0619 (in 77290 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791918s. THTS: Maximal search depth set to 65 Search time: 0.791924s Statistics of THTS: Performed trials: 194133 Created SearchNodes: 952926 Cache Hits: 4436 Action Selection: Exploitation in Root: 122182 Exploration in Root: 71951 Percentage Exploration in Root: 0.370627 Skipped backups: 1348346209 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0322 (in 194137 real visits) Q-Value Estimates: noop() : -21.142 (in 38232 real visits) roll(d3) : -21.0322 (in 78627 real visits) roll(d2) : -22.3942 (in 2074 real visits) roll(d1) : -21.0387 (in 75204 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 0 | horizon: 65 Setting time for this decision to 0.791918s. THTS: Maximal search depth set to 65 Search time: 0.791921s Statistics of THTS: Performed trials: 186695 Created SearchNodes: 914600 Cache Hits: 4720 Action Selection: Exploitation in Root: 176129 Exploration in Root: 10566 Percentage Exploration in Root: 0.056595 Skipped backups: 1349403495 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9329 (in 186699 real visits) Q-Value Estimates: noop() : -27.4506 (in 3523 real visits) roll(d3) : -25.9329 (in 176130 real visits) roll(d2) : -35.0996 (in 3523 real visits) roll(d1) : -29.6531 (in 3523 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.791913s. THTS: Maximal search depth set to 65 Search time: 0.791918s Statistics of THTS: Performed trials: 186158 Created SearchNodes: 912179 Cache Hits: 4654 Action Selection: Exploitation in Root: 173998 Exploration in Root: 12160 Percentage Exploration in Root: 0.0653209 Skipped backups: 1350456153 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9156 (in 186162 real visits) Q-Value Estimates: noop() : -25.9149 (in 5206 real visits) roll(d3) : -24.9156 (in 173996 real visits) roll(d2) : -32.7951 (in 3480 real visits) roll(d1) : -27.2599 (in 3480 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 1 | horizon: 65 Setting time for this decision to 0.791913s. THTS: Maximal search depth set to 65 Search time: 0.791916s Statistics of THTS: Performed trials: 187241 Created SearchNodes: 917434 Cache Hits: 4694 Action Selection: Exploitation in Root: 175125 Exploration in Root: 12116 Percentage Exploration in Root: 0.0647081 Skipped backups: 1351517017 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.9294 (in 187245 real visits) Q-Value Estimates: noop() : -25.9365 (in 5114 real visits) roll(d3) : -24.9294 (in 175125 real visits) roll(d2) : -32.9342 (in 3503 real visits) roll(d1) : -27.2445 (in 3503 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791908s. THTS: Maximal search depth set to 65 Search time: 0.791914s Statistics of THTS: Performed trials: 194651 Created SearchNodes: 955708 Cache Hits: 4388 Action Selection: Exploitation in Root: 124709 Exploration in Root: 69942 Percentage Exploration in Root: 0.35932 Skipped backups: 1352544079 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.041 (in 194655 real visits) Q-Value Estimates: noop() : -21.1621 (in 37079 real visits) roll(d3) : -21.0434 (in 78101 real visits) roll(d2) : -22.3463 (in 2200 real visits) roll(d1) : -21.041 (in 77275 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 2 5 4 | horizon: 65 Setting time for this decision to 0.791907s. THTS: Maximal search depth set to 65 Search time: 0.791912s Statistics of THTS: Performed trials: 186850 Created SearchNodes: 915799 Cache Hits: 4614 Action Selection: Exploitation in Root: 169344 Exploration in Root: 17506 Percentage Exploration in Root: 0.0936901 Skipped backups: 1353588015 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.8851 (in 186854 real visits) Q-Value Estimates: noop() : -24.5482 (in 9351 real visits) roll(d3) : -24.8948 (in 4774 real visits) roll(d2) : -30.1904 (in 3387 real visits) roll(d1) : -23.8851 (in 169342 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791903s. THTS: Maximal search depth set to 65 Search time: 0.791906s Statistics of THTS: Performed trials: 183180 Created SearchNodes: 897805 Cache Hits: 4525 Action Selection: Exploitation in Root: 170941 Exploration in Root: 12239 Percentage Exploration in Root: 0.0668141 Skipped backups: 1354619671 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.8985 (in 183184 real visits) Q-Value Estimates: noop() : -25.8856 (in 5405 real visits) roll(d3) : -27.2292 (in 3419 real visits) roll(d2) : -32.814 (in 3419 real visits) roll(d1) : -24.8985 (in 170941 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.791902s. THTS: Maximal search depth set to 65 Search time: 0.791908s Statistics of THTS: Performed trials: 183281 Created SearchNodes: 897870 Cache Hits: 4635 Action Selection: Exploitation in Root: 171447 Exploration in Root: 11834 Percentage Exploration in Root: 0.0645675 Skipped backups: 1355650115 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.8971 (in 183285 real visits) Q-Value Estimates: noop() : -25.9258 (in 4980 real visits) roll(d3) : -27.2654 (in 3429 real visits) roll(d2) : -32.8741 (in 3429 real visits) roll(d1) : -24.8971 (in 171447 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 4 | horizon: 65 Setting time for this decision to 0.791897s. THTS: Maximal search depth set to 65 Search time: 0.791903s Statistics of THTS: Performed trials: 183151 Created SearchNodes: 896864 Cache Hits: 4724 Action Selection: Exploitation in Root: 172790 Exploration in Root: 10361 Percentage Exploration in Root: 0.0565708 Skipped backups: 1356687089 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9136 (in 183155 real visits) Q-Value Estimates: noop() : -27.3241 (in 3456 real visits) roll(d3) : -29.5476 (in 3456 real visits) roll(d2) : -35.22 (in 3456 real visits) roll(d1) : -25.9136 (in 172787 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 4 | horizon: 65 Setting time for this decision to 0.791897s. THTS: Maximal search depth set to 65 Search time: 0.7919s Statistics of THTS: Performed trials: 182635 Created SearchNodes: 894716 Cache Hits: 4616 Action Selection: Exploitation in Root: 172301 Exploration in Root: 10334 Percentage Exploration in Root: 0.0565828 Skipped backups: 1357716699 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9197 (in 182639 real visits) Q-Value Estimates: noop() : -27.4032 (in 3446 real visits) roll(d3) : -29.4483 (in 3446 real visits) roll(d2) : -35.248 (in 3446 real visits) roll(d1) : -25.9197 (in 172301 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 4 5 4 | horizon: 65 Setting time for this decision to 0.791892s. THTS: Maximal search depth set to 65 Search time: 0.791897s Statistics of THTS: Performed trials: 191942 Created SearchNodes: 942383 Cache Hits: 4333 Action Selection: Exploitation in Root: 109663 Exploration in Root: 82279 Percentage Exploration in Root: 0.428666 Skipped backups: 1358729623 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -21.0494 (in 191946 real visits) Q-Value Estimates: noop() : -21.1758 (in 36454 real visits) roll(d3) : -21.0499 (in 77111 real visits) roll(d2) : -22.3763 (in 2135 real visits) roll(d1) : -21.0494 (in 76246 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 0 5 4 | horizon: 65 Setting time for this decision to 0.791887s. THTS: Maximal search depth set to 65 Search time: 0.791891s Statistics of THTS: Performed trials: 187024 Created SearchNodes: 916333 Cache Hits: 4698 Action Selection: Exploitation in Root: 176442 Exploration in Root: 10582 Percentage Exploration in Root: 0.056581 Skipped backups: 1359788133 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9235 (in 187028 real visits) Q-Value Estimates: noop() : -27.5846 (in 3529 real visits) roll(d3) : -29.326 (in 3529 real visits) roll(d2) : -35.2265 (in 3529 real visits) roll(d1) : -25.9235 (in 176441 real visits) Used RAM: 325172 Submitted action: roll(d1) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.791886s. THTS: Maximal search depth set to 65 Search time: 0.79189s Statistics of THTS: Performed trials: 179539 Created SearchNodes: 858504 Cache Hits: 9799 Action Selection: Exploitation in Root: 146435 Exploration in Root: 33104 Percentage Exploration in Root: 0.184383 Skipped backups: 1360803403 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.2454 (in 179543 real visits) Q-Value Estimates: noop() : -12.3921 (in 27428 real visits) roll(d3) : -12.2454 (in 146263 real visits) roll(d2) : -16.4826 (in 2926 real visits) roll(d1) : -16.2157 (in 2926 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 5 5 0 | horizon: 65 Setting time for this decision to 0.791886s. THTS: Maximal search depth set to 65 Search time: 0.791888s Statistics of THTS: Performed trials: 176817 Created SearchNodes: 845142 Cache Hits: 9737 Action Selection: Exploitation in Root: 166809 Exploration in Root: 10008 Percentage Exploration in Root: 0.0566009 Skipped backups: 1361801503 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.3072 (in 176821 real visits) Q-Value Estimates: noop() : -19.5708 (in 3337 real visits) roll(d3) : -16.3072 (in 166810 real visits) roll(d2) : -28.4216 (in 3337 real visits) roll(d1) : -28.4698 (in 3337 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 5 5 1 | horizon: 65 Setting time for this decision to 0.791881s. THTS: Maximal search depth set to 65 Search time: 0.791887s Statistics of THTS: Performed trials: 176325 Created SearchNodes: 843210 Cache Hits: 9605 Action Selection: Exploitation in Root: 166348 Exploration in Root: 9977 Percentage Exploration in Root: 0.056583 Skipped backups: 1362798985 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -15.3058 (in 176329 real visits) Q-Value Estimates: noop() : -17.3989 (in 3327 real visits) roll(d3) : -15.3058 (in 166348 real visits) roll(d2) : -26.094 (in 3327 real visits) roll(d1) : -25.8347 (in 3327 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 5 5 0 | horizon: 65 Setting time for this decision to 0.79188s. THTS: Maximal search depth set to 65 Search time: 0.791883s Statistics of THTS: Performed trials: 176510 Created SearchNodes: 843671 Cache Hits: 9721 Action Selection: Exploitation in Root: 166521 Exploration in Root: 9989 Percentage Exploration in Root: 0.0565917 Skipped backups: 1363793989 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -16.3033 (in 176514 real visits) Q-Value Estimates: noop() : -19.4175 (in 3331 real visits) roll(d3) : -16.3033 (in 166521 real visits) roll(d2) : -28.367 (in 3331 real visits) roll(d1) : -28.4059 (in 3331 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 7/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.791875s. THTS: Maximal search depth set to 65 Search time: 0.791879s Statistics of THTS: Performed trials: 179061 Created SearchNodes: 856418 Cache Hits: 9723 Action Selection: Exploitation in Root: 146079 Exploration in Root: 32982 Percentage Exploration in Root: 0.184194 Skipped backups: 1364803435 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.2495 (in 179065 real visits) Q-Value Estimates: noop() : -12.4028 (in 27335 real visits) roll(d3) : -12.2495 (in 145894 real visits) roll(d2) : -16.4869 (in 2918 real visits) roll(d1) : -16.3849 (in 2918 real visits) Used RAM: 325172 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 7 -- REWARD RECEIVED: -229 *********************************************** *********************************************** >>> STARTING ROUND 8 -- REMAINING TIME 173s *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.873087s. THTS: Maximal search depth set to 65 Search time: 0.873091s Statistics of THTS: Performed trials: 219255 Created SearchNodes: 1090856 Cache Hits: 1356 Action Selection: Exploitation in Root: 106292 Exploration in Root: 112963 Percentage Exploration in Root: 0.515213 Skipped backups: 1365932025 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.6956 (in 219259 real visits) Q-Value Estimates: noop() : -69.1713 (in 1479 real visits) roll(d3) : -62.7022 (in 72231 real visits) roll(d2) : -62.7031 (in 71601 real visits) roll(d1) : -62.6956 (in 73948 real visits) Used RAM: 333092 Submitted action: roll(d1) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 0.873082s. THTS: Maximal search depth set to 65 Search time: 0.873089s Statistics of THTS: Performed trials: 219067 Created SearchNodes: 1089872 Cache Hits: 1367 Action Selection: Exploitation in Root: 85847 Exploration in Root: 133220 Percentage Exploration in Root: 0.608124 Skipped backups: 1367058865 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -62.7097 (in 219071 real visits) Q-Value Estimates: noop() : -69.6528 (in 1480 real visits) roll(d3) : -62.7219 (in 71855 real visits) roll(d2) : -62.7097 (in 73984 real visits) roll(d1) : -62.7221 (in 71752 real visits) Used RAM: 333092 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 0 5 0 | horizon: 65 Setting time for this decision to 0.873083s. THTS: Maximal search depth set to 65 Search time: 0.873087s Statistics of THTS: Performed trials: 206549 Created SearchNodes: 1010158 Cache Hits: 5648 Action Selection: Exploitation in Root: 127939 Exploration in Root: 78610 Percentage Exploration in Root: 0.380588 Skipped backups: 1368135533 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -37.1413 (in 206553 real visits) Q-Value Estimates: noop() : -41.9491 (in 2066 real visits) roll(d3) : -37.1493 (in 99142 real visits) roll(d2) : -52.3653 (in 2066 real visits) roll(d1) : -37.1413 (in 103279 real visits) Used RAM: 333356 Submitted action: roll(d1) Immediate reward: -10 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 1 5 0 | horizon: 65 Setting time for this decision to 0.873078s. THTS: Maximal search depth set to 65 Search time: 0.873081s Statistics of THTS: Performed trials: 206162 Created SearchNodes: 1008419 Cache Hits: 5599 Action Selection: Exploitation in Root: 146915 Exploration in Root: 59247 Percentage Exploration in Root: 0.287381 Skipped backups: 1369217405 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -35.2753 (in 206166 real visits) Q-Value Estimates: noop() : -39.4019 (in 2939 real visits) roll(d3) : -35.2753 (in 146913 real visits) roll(d2) : -49.3136 (in 2939 real visits) roll(d1) : -35.4887 (in 53375 real visits) Used RAM: 333356 Submitted action: roll(d3) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 1 5 0 | horizon: 65 Setting time for this decision to 0.873073s. THTS: Maximal search depth set to 65 Search time: 0.87308s Statistics of THTS: Performed trials: 206350 Created SearchNodes: 1009571 Cache Hits: 5546 Action Selection: Exploitation in Root: 148139 Exploration in Root: 58211 Percentage Exploration in Root: 0.282098 Skipped backups: 1370302457 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -35.2781 (in 206354 real visits) Q-Value Estimates: noop() : -39.5093 (in 2963 real visits) roll(d3) : -35.2781 (in 148133 real visits) roll(d2) : -49.2532 (in 2963 real visits) roll(d1) : -35.4972 (in 52295 real visits) Used RAM: 333356 Submitted action: roll(d3) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 1 5 4 | horizon: 65 Setting time for this decision to 0.873074s. THTS: Maximal search depth set to 65 Search time: 0.873079s Statistics of THTS: Performed trials: 203103 Created SearchNodes: 995008 Cache Hits: 5128 Action Selection: Exploitation in Root: 189876 Exploration in Root: 13227 Percentage Exploration in Root: 0.0651246 Skipped backups: 1371463095 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.0083 (in 203107 real visits) Q-Value Estimates: noop() : -25.9766 (in 5636 real visits) roll(d3) : -27.432 (in 3798 real visits) roll(d2) : -33.1052 (in 3798 real visits) roll(d1) : -25.0083 (in 189875 real visits) Used RAM: 333356 Submitted action: roll(d1) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 8/10 Current state: | 5 5 4 | horizon: 65 Setting time for this decision to 0.873069s. THTS: Maximal search depth set to 65 Search time: 0.873072s Statistics of THTS: Performed trials: 195535 Created SearchNodes: 934576 Cache Hits: 10776 Action Selection: Exploitation in Root: 159654 Exploration in Root: 35881 Percentage Exploration in Root: 0.183502 Skipped backups: 1372572901 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.2723 (in 195539 real visits) Q-Value Estimates: noop() : -12.3945 (in 29635 real visits) roll(d3) : -12.2723 (in 159522 real visits) roll(d2) : -16.4929 (in 3191 real visits) roll(d1) : -16.5791 (in 3191 real visits) Used RAM: 333356 Submitted action: roll(d3) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 8 -- REWARD RECEIVED: -64 *********************************************** *********************************************** >>> STARTING ROUND 9 -- REMAINING TIME 167s *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 1.26258s. THTS: Maximal search depth set to 65 Search time: 1.26259s Statistics of THTS: Performed trials: 311779 Created SearchNodes: 1550792 Cache Hits: 2027 Action Selection: Exploitation in Root: 168387 Exploration in Root: 143392 Percentage Exploration in Root: 0.459916 Skipped backups: 1374245777 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -63.3346 (in 311783 real visits) Q-Value Estimates: noop() : -70.6065 (in 2077 real visits) roll(d3) : -63.3433 (in 102058 real visits) roll(d2) : -63.3346 (in 103808 real visits) roll(d1) : -63.3355 (in 103840 real visits) Used RAM: 376388 Submitted action: roll(d2) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 2 0 | horizon: 65 Setting time for this decision to 1.26258s. THTS: Maximal search depth set to 65 Search time: 1.26258s Statistics of THTS: Performed trials: 303880 Created SearchNodes: 1511405 Cache Hits: 2000 Action Selection: Exploitation in Root: 195832 Exploration in Root: 108048 Percentage Exploration in Root: 0.355561 Skipped backups: 1375903291 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.8342 (in 303884 real visits) Q-Value Estimates: noop() : -62.225 (in 2886 real visits) roll(d3) : -56.8342 (in 144282 real visits) roll(d2) : -58.0979 (in 12652 real visits) roll(d1) : -56.8351 (in 144064 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 2 0 | horizon: 65 Setting time for this decision to 1.26257s. THTS: Maximal search depth set to 65 Search time: 1.26257s Statistics of THTS: Performed trials: 302928 Created SearchNodes: 1506573 Cache Hits: 2018 Action Selection: Exploitation in Root: 172135 Exploration in Root: 130793 Percentage Exploration in Root: 0.431763 Skipped backups: 1377553815 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -56.8331 (in 302932 real visits) Q-Value Estimates: noop() : -61.7935 (in 2916 real visits) roll(d3) : -56.8331 (in 145772 real visits) roll(d2) : -58.0456 (in 13445 real visits) roll(d1) : -56.843 (in 140799 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -13 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 0 2 2 | horizon: 65 Setting time for this decision to 1.26257s. THTS: Maximal search depth set to 65 Search time: 1.26257s Statistics of THTS: Performed trials: 300906 Created SearchNodes: 1496791 Cache Hits: 1936 Action Selection: Exploitation in Root: 215652 Exploration in Root: 85254 Percentage Exploration in Root: 0.283324 Skipped backups: 1379166809 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -52.1341 (in 300910 real visits) Q-Value Estimates: noop() : -55.8049 (in 4314 real visits) roll(d3) : -52.655 (in 40577 real visits) roll(d2) : -52.6551 (in 40366 real visits) roll(d1) : -52.1341 (in 215653 real visits) Used RAM: 376388 Submitted action: roll(d1) Immediate reward: -11 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 2 | horizon: 65 Setting time for this decision to 1.26256s. THTS: Maximal search depth set to 65 Search time: 1.26257s Statistics of THTS: Performed trials: 286685 Created SearchNodes: 1401870 Cache Hits: 7890 Action Selection: Exploitation in Root: 209155 Exploration in Root: 77530 Percentage Exploration in Root: 0.270436 Skipped backups: 1380708103 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.6721 (in 286689 real visits) Q-Value Estimates: noop() : -31.9812 (in 4686 real visits) roll(d3) : -30.677 (in 138976 real visits) roll(d2) : -30.6721 (in 140222 real visits) roll(d1) : -40.1781 (in 2805 real visits) Used RAM: 376388 Submitted action: roll(d2) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 2 | horizon: 65 Setting time for this decision to 1.26256s. THTS: Maximal search depth set to 65 Search time: 1.26256s Statistics of THTS: Performed trials: 290679 Created SearchNodes: 1421728 Cache Hits: 7918 Action Selection: Exploitation in Root: 183671 Exploration in Root: 107008 Percentage Exploration in Root: 0.368131 Skipped backups: 1382273365 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -30.6953 (in 290683 real visits) Q-Value Estimates: noop() : -31.9772 (in 4840 real visits) roll(d3) : -30.6953 (in 144732 real visits) roll(d2) : -30.7022 (in 138216 real visits) roll(d1) : -40.2058 (in 2895 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 0 | horizon: 65 Setting time for this decision to 1.26256s. THTS: Maximal search depth set to 65 Search time: 1.26256s Statistics of THTS: Performed trials: 286720 Created SearchNodes: 1402421 Cache Hits: 7796 Action Selection: Exploitation in Root: 249473 Exploration in Root: 37247 Percentage Exploration in Root: 0.129907 Skipped backups: 1383894573 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.3098 (in 286724 real visits) Q-Value Estimates: noop() : -36.7454 (in 4990 real visits) roll(d3) : -33.3098 (in 249473 real visits) roll(d2) : -33.7928 (in 27271 real visits) roll(d1) : -46.2593 (in 4990 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 0 | horizon: 65 Setting time for this decision to 1.26254s. THTS: Maximal search depth set to 65 Search time: 1.26255s Statistics of THTS: Performed trials: 286182 Created SearchNodes: 1399011 Cache Hits: 7976 Action Selection: Exploitation in Root: 248770 Exploration in Root: 37412 Percentage Exploration in Root: 0.130728 Skipped backups: 1385503973 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.2913 (in 286186 real visits) Q-Value Estimates: noop() : -36.6532 (in 4976 real visits) roll(d3) : -33.2913 (in 248771 real visits) roll(d2) : -33.7635 (in 27463 real visits) roll(d1) : -46.3926 (in 4976 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 0 | horizon: 65 Setting time for this decision to 1.26254s. THTS: Maximal search depth set to 65 Search time: 1.26255s Statistics of THTS: Performed trials: 280577 Created SearchNodes: 1371262 Cache Hits: 7907 Action Selection: Exploitation in Root: 243912 Exploration in Root: 36665 Percentage Exploration in Root: 0.130677 Skipped backups: 1387082797 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -33.2667 (in 280581 real visits) Q-Value Estimates: noop() : -36.6743 (in 4879 real visits) roll(d3) : -33.2667 (in 243910 real visits) roll(d2) : -33.747 (in 26913 real visits) roll(d1) : -45.8326 (in 4879 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 2 3 | horizon: 65 Setting time for this decision to 1.26254s. THTS: Maximal search depth set to 65 Search time: 1.26254s Statistics of THTS: Performed trials: 282578 Created SearchNodes: 1382119 Cache Hits: 7694 Action Selection: Exploitation in Root: 225347 Exploration in Root: 57231 Percentage Exploration in Root: 0.202532 Skipped backups: 1388650585 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -28.1943 (in 282582 real visits) Q-Value Estimates: noop() : -29.1142 (in 7830 real visits) roll(d3) : -28.4573 (in 44905 real visits) roll(d2) : -28.1943 (in 225340 real visits) roll(d1) : -36.2771 (in 4507 real visits) Used RAM: 376388 Submitted action: roll(d2) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 3 | horizon: 65 Setting time for this decision to 1.26253s. THTS: Maximal search depth set to 65 Search time: 1.26254s Statistics of THTS: Performed trials: 288229 Created SearchNodes: 1411910 Cache Hits: 7310 Action Selection: Exploitation in Root: 234008 Exploration in Root: 54221 Percentage Exploration in Root: 0.188118 Skipped backups: 1390317907 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.2494 (in 288233 real visits) Q-Value Estimates: noop() : -23.5811 (in 27224 real visits) roll(d3) : -23.2494 (in 234006 real visits) roll(d2) : -23.6324 (in 22322 real visits) roll(d1) : -27.5928 (in 4681 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 1 | horizon: 65 Setting time for this decision to 1.26253s. THTS: Maximal search depth set to 65 Search time: 1.26254s Statistics of THTS: Performed trials: 284583 Created SearchNodes: 1393772 Cache Hits: 7287 Action Selection: Exploitation in Root: 266557 Exploration in Root: 18026 Percentage Exploration in Root: 0.0633418 Skipped backups: 1392014761 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.3922 (in 284587 real visits) Q-Value Estimates: noop() : -26.2843 (in 7368 real visits) roll(d3) : -25.3922 (in 266555 real visits) roll(d2) : -27.7571 (in 5332 real visits) roll(d1) : -33.7417 (in 5332 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 3 | horizon: 65 Setting time for this decision to 1.26253s. THTS: Maximal search depth set to 65 Search time: 1.26253s Statistics of THTS: Performed trials: 288417 Created SearchNodes: 1412794 Cache Hits: 7324 Action Selection: Exploitation in Root: 235812 Exploration in Root: 52605 Percentage Exploration in Root: 0.182392 Skipped backups: 1393686075 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -23.244 (in 288421 real visits) Q-Value Estimates: noop() : -23.5787 (in 27073 real visits) roll(d3) : -23.244 (in 235805 real visits) roll(d2) : -23.6474 (in 20826 real visits) roll(d1) : -27.6711 (in 4717 real visits) Used RAM: 376388 Submitted action: roll(d3) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 9/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 1.26252s. THTS: Maximal search depth set to 65 Search time: 1.26253s Statistics of THTS: Performed trials: 272388 Created SearchNodes: 1302345 Cache Hits: 14900 Action Selection: Exploitation in Root: 224429 Exploration in Root: 47959 Percentage Exploration in Root: 0.176069 Skipped backups: 1395294983 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.4329 (in 272392 real visits) Q-Value Estimates: noop() : -12.5654 (in 39044 real visits) roll(d3) : -16.8681 (in 4488 real visits) roll(d2) : -12.4329 (in 224372 real visits) roll(d1) : -16.8025 (in 4488 real visits) Used RAM: 376388 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 9 -- REWARD RECEIVED: -105 *********************************************** *********************************************** >>> STARTING ROUND 10 -- REMAINING TIME 149s *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 0 0 | horizon: 65 Setting time for this decision to 2.25309s. THTS: Maximal search depth set to 65 Search time: 2.2531s Statistics of THTS: Performed trials: 531456 Created SearchNodes: 2642173 Cache Hits: 3778 Action Selection: Exploitation in Root: 290363 Exploration in Root: 241093 Percentage Exploration in Root: 0.453646 Skipped backups: 1398318651 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -64.1874 (in 531460 real visits) Q-Value Estimates: noop() : -71.0634 (in 3556 real visits) roll(d3) : -64.1874 (in 177764 real visits) roll(d2) : -64.1928 (in 174679 real visits) roll(d1) : -64.188 (in 175461 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -15 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 0 1 | horizon: 65 Setting time for this decision to 2.25308s. THTS: Maximal search depth set to 65 Search time: 2.25308s Statistics of THTS: Performed trials: 516920 Created SearchNodes: 2569825 Cache Hits: 3695 Action Selection: Exploitation in Root: 308349 Exploration in Root: 208571 Percentage Exploration in Root: 0.403488 Skipped backups: 1401265337 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.3651 (in 516924 real visits) Q-Value Estimates: noop() : -67.6694 (in 4441 real visits) roll(d3) : -61.7264 (in 71339 real visits) roll(d2) : -61.3651 (in 222046 real visits) roll(d1) : -61.3674 (in 219098 real visits) Used RAM: 478556 Submitted action: roll(d2) Immediate reward: -14 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 0 0 1 | horizon: 65 Setting time for this decision to 2.25306s. THTS: Maximal search depth set to 65 Search time: 2.25307s Statistics of THTS: Performed trials: 516671 Created SearchNodes: 2568560 Cache Hits: 3700 Action Selection: Exploitation in Root: 296917 Exploration in Root: 219754 Percentage Exploration in Root: 0.425327 Skipped backups: 1404206965 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -61.3475 (in 516675 real visits) Q-Value Estimates: noop() : -67.7037 (in 4455 real visits) roll(d3) : -61.7095 (in 71445 real visits) roll(d2) : -61.3526 (in 218037 real visits) roll(d1) : -61.3475 (in 222738 real visits) Used RAM: 478556 Submitted action: roll(d1) Immediate reward: -14 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 0 1 | horizon: 65 Setting time for this decision to 2.25306s. THTS: Maximal search depth set to 65 Search time: 2.25307s Statistics of THTS: Performed trials: 474121 Created SearchNodes: 2316470 Cache Hits: 13535 Action Selection: Exploitation in Root: 343582 Exploration in Root: 130539 Percentage Exploration in Root: 0.275328 Skipped backups: 1406992099 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.146 (in 474125 real visits) Q-Value Estimates: noop() : -40.3381 (in 6872 real visits) roll(d3) : -36.3013 (in 116820 real visits) roll(d2) : -36.146 (in 343561 real visits) roll(d1) : -50.6056 (in 6872 real visits) Used RAM: 478556 Submitted action: roll(d2) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 1 1 | horizon: 65 Setting time for this decision to 2.25305s. THTS: Maximal search depth set to 65 Search time: 2.25305s Statistics of THTS: Performed trials: 483092 Created SearchNodes: 2360261 Cache Hits: 13801 Action Selection: Exploitation in Root: 325496 Exploration in Root: 157596 Percentage Exploration in Root: 0.326224 Skipped backups: 1409782101 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.747 (in 483096 real visits) Q-Value Estimates: noop() : -37.7514 (in 4769 real visits) roll(d3) : -34.747 (in 235126 real visits) roll(d2) : -34.7472 (in 238432 real visits) roll(d1) : -47.3618 (in 4769 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 1 0 | horizon: 65 Setting time for this decision to 2.25303s. THTS: Maximal search depth set to 65 Search time: 2.25304s Statistics of THTS: Performed trials: 481352 Created SearchNodes: 2352085 Cache Hits: 13670 Action Selection: Exploitation in Root: 345463 Exploration in Root: 135889 Percentage Exploration in Root: 0.282307 Skipped backups: 1412608917 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -36.1498 (in 481356 real visits) Q-Value Estimates: noop() : -40.4007 (in 6910 real visits) roll(d3) : -36.1498 (in 345460 real visits) roll(d2) : -36.3014 (in 122076 real visits) roll(d1) : -50.7038 (in 6910 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -9 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 1 1 | horizon: 65 Setting time for this decision to 2.25303s. THTS: Maximal search depth set to 65 Search time: 2.25304s Statistics of THTS: Performed trials: 484940 Created SearchNodes: 2368877 Cache Hits: 13957 Action Selection: Exploitation in Root: 343528 Exploration in Root: 141412 Percentage Exploration in Root: 0.291607 Skipped backups: 1415415225 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -34.7487 (in 484944 real visits) Q-Value Estimates: noop() : -37.6046 (in 4767 real visits) roll(d3) : -34.7498 (in 237105 real visits) roll(d2) : -34.7487 (in 238305 real visits) roll(d1) : -47.3101 (in 4767 real visits) Used RAM: 478556 Submitted action: roll(d2) Immediate reward: -8 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 1 | horizon: 65 Setting time for this decision to 2.25302s. THTS: Maximal search depth set to 65 Search time: 2.25302s Statistics of THTS: Performed trials: 478097 Created SearchNodes: 2339162 Cache Hits: 12832 Action Selection: Exploitation in Root: 449691 Exploration in Root: 28406 Percentage Exploration in Root: 0.0594147 Skipped backups: 1418448153 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9086 (in 478101 real visits) Q-Value Estimates: noop() : -26.6875 (in 10422 real visits) roll(d3) : -25.9086 (in 449691 real visits) roll(d2) : -28.2253 (in 8994 real visits) roll(d1) : -34.5185 (in 8994 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 2 | horizon: 65 Setting time for this decision to 2.253s. THTS: Maximal search depth set to 65 Search time: 2.25301s Statistics of THTS: Performed trials: 480132 Created SearchNodes: 2349581 Cache Hits: 12771 Action Selection: Exploitation in Root: 441832 Exploration in Root: 38300 Percentage Exploration in Root: 0.0797697 Skipped backups: 1421485609 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.8798 (in 480136 real visits) Q-Value Estimates: noop() : -25.3738 (in 20631 real visits) roll(d3) : -24.8798 (in 441831 real visits) roll(d2) : -25.7626 (in 8837 real visits) roll(d1) : -31.8754 (in 8837 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 2 | horizon: 65 Setting time for this decision to 2.253s. THTS: Maximal search depth set to 65 Search time: 2.25301s Statistics of THTS: Performed trials: 480639 Created SearchNodes: 2352088 Cache Hits: 12778 Action Selection: Exploitation in Root: 441841 Exploration in Root: 38798 Percentage Exploration in Root: 0.0807217 Skipped backups: 1424528141 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.8878 (in 480643 real visits) Q-Value Estimates: noop() : -25.3759 (in 20964 real visits) roll(d3) : -24.8878 (in 441838 real visits) roll(d2) : -25.7079 (in 9004 real visits) roll(d1) : -31.7542 (in 8837 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 1 | horizon: 65 Setting time for this decision to 2.25298s. THTS: Maximal search depth set to 65 Search time: 2.25299s Statistics of THTS: Performed trials: 479783 Created SearchNodes: 2347484 Cache Hits: 12859 Action Selection: Exploitation in Root: 450856 Exploration in Root: 28927 Percentage Exploration in Root: 0.0602918 Skipped backups: 1427577783 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.918 (in 479787 real visits) Q-Value Estimates: noop() : -26.6766 (in 10896 real visits) roll(d3) : -25.918 (in 450855 real visits) roll(d2) : -28.3239 (in 9018 real visits) roll(d1) : -34.4103 (in 9018 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 2 | horizon: 65 Setting time for this decision to 2.25296s. THTS: Maximal search depth set to 65 Search time: 2.25297s Statistics of THTS: Performed trials: 476897 Created SearchNodes: 2333422 Cache Hits: 12767 Action Selection: Exploitation in Root: 438987 Exploration in Root: 37910 Percentage Exploration in Root: 0.0794931 Skipped backups: 1430594357 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -24.8887 (in 476901 real visits) Q-Value Estimates: noop() : -25.3964 (in 19647 real visits) roll(d3) : -24.8887 (in 438982 real visits) roll(d2) : -25.6804 (in 9492 real visits) roll(d1) : -31.8865 (in 8780 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -4 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 1 | horizon: 65 Setting time for this decision to 2.25294s. THTS: Maximal search depth set to 65 Search time: 2.25295s Statistics of THTS: Performed trials: 479228 Created SearchNodes: 2344437 Cache Hits: 12927 Action Selection: Exploitation in Root: 450946 Exploration in Root: 28282 Percentage Exploration in Root: 0.0590158 Skipped backups: 1433634209 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.9026 (in 479232 real visits) Q-Value Estimates: noop() : -26.6906 (in 10248 real visits) roll(d3) : -25.9026 (in 450946 real visits) roll(d2) : -28.3398 (in 9019 real visits) roll(d1) : -34.5064 (in 9019 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 1 | horizon: 65 Setting time for this decision to 2.25294s. THTS: Maximal search depth set to 65 Search time: 2.25295s Statistics of THTS: Performed trials: 477218 Created SearchNodes: 2334527 Cache Hits: 12892 Action Selection: Exploitation in Root: 448494 Exploration in Root: 28724 Percentage Exploration in Root: 0.0601905 Skipped backups: 1436661653 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.8978 (in 477222 real visits) Q-Value Estimates: noop() : -26.663 (in 10790 real visits) roll(d3) : -25.8978 (in 448492 real visits) roll(d2) : -28.2502 (in 8970 real visits) roll(d1) : -34.5044 (in 8970 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 4 | horizon: 65 Setting time for this decision to 2.25292s. THTS: Maximal search depth set to 65 Search time: 2.25293s Statistics of THTS: Performed trials: 496324 Created SearchNodes: 2432229 Cache Hits: 12349 Action Selection: Exploitation in Root: 349425 Exploration in Root: 146899 Percentage Exploration in Root: 0.295974 Skipped backups: 1439622897 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -22.0945 (in 496328 real visits) Q-Value Estimates: noop() : -22.1861 (in 88587 real visits) roll(d3) : -22.0945 (in 202759 real visits) roll(d2) : -22.0946 (in 200816 real visits) roll(d1) : -23.1596 (in 4166 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -2 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 0 | horizon: 65 Setting time for this decision to 2.2529s. THTS: Maximal search depth set to 65 Search time: 2.25291s Statistics of THTS: Performed trials: 476253 Created SearchNodes: 2330158 Cache Hits: 12778 Action Selection: Exploitation in Root: 449299 Exploration in Root: 26954 Percentage Exploration in Root: 0.056596 Skipped backups: 1442647489 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -26.9135 (in 476257 real visits) Q-Value Estimates: noop() : -28.5762 (in 8986 real visits) roll(d3) : -26.9135 (in 449299 real visits) roll(d2) : -30.5717 (in 8986 real visits) roll(d1) : -36.8524 (in 8986 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 1 | horizon: 65 Setting time for this decision to 2.2529s. THTS: Maximal search depth set to 65 Search time: 2.2529s Statistics of THTS: Performed trials: 478623 Created SearchNodes: 2341088 Cache Hits: 13008 Action Selection: Exploitation in Root: 449792 Exploration in Root: 28831 Percentage Exploration in Root: 0.0602374 Skipped backups: 1445682955 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -25.8985 (in 478627 real visits) Q-Value Estimates: noop() : -26.6604 (in 10843 real visits) roll(d3) : -25.8985 (in 449792 real visits) roll(d2) : -28.2795 (in 8996 real visits) roll(d1) : -34.4896 (in 8996 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -5 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 0 | horizon: 65 Setting time for this decision to 2.25287s. THTS: Maximal search depth set to 65 Search time: 2.25288s Statistics of THTS: Performed trials: 477601 Created SearchNodes: 2336462 Cache Hits: 12887 Action Selection: Exploitation in Root: 450568 Exploration in Root: 27033 Percentage Exploration in Root: 0.0566016 Skipped backups: 1448715813 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -26.9069 (in 477605 real visits) Q-Value Estimates: noop() : -28.544 (in 9012 real visits) roll(d3) : -26.9069 (in 450569 real visits) roll(d2) : -30.5003 (in 9012 real visits) roll(d1) : -36.6461 (in 9012 real visits) Used RAM: 478556 Submitted action: roll(d3) Immediate reward: -6 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 2.25287s. THTS: Maximal search depth set to 65 Search time: 2.25288s Statistics of THTS: Performed trials: 455972 Created SearchNodes: 2183185 Cache Hits: 24170 Action Selection: Exploitation in Root: 382593 Exploration in Root: 73379 Percentage Exploration in Root: 0.160929 Skipped backups: 1451637707 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.6536 (in 455976 real visits) Q-Value Estimates: noop() : -12.7695 (in 58220 real visits) roll(d3) : -17.4124 (in 7650 real visits) roll(d2) : -12.6536 (in 382456 real visits) roll(d1) : -17.5063 (in 7650 real visits) Used RAM: 478556 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 2 5 | horizon: 65 Setting time for this decision to 2.25285s. THTS: Maximal search depth set to 65 Search time: 2.25285s Statistics of THTS: Performed trials: 444460 Created SearchNodes: 2128929 Cache Hits: 23344 Action Selection: Exploitation in Root: 419304 Exploration in Root: 25156 Percentage Exploration in Root: 0.056599 Skipped backups: 1454507507 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -14.6905 (in 444464 real visits) Q-Value Estimates: noop() : -15.9254 (in 8387 real visits) roll(d3) : -24.6911 (in 8387 real visits) roll(d2) : -14.6905 (in 419303 real visits) roll(d1) : -24.7127 (in 8387 real visits) Used RAM: 478556 Submitted action: roll(d2) Immediate reward: -3 *********************************************** *********************************************** Planning step 0/65 in round 10/10 Current state: | 5 4 5 | horizon: 65 Setting time for this decision to 2.25282s. THTS: Maximal search depth set to 65 Search time: 2.25283s Statistics of THTS: Performed trials: 447562 Created SearchNodes: 2143211 Cache Hits: 23651 Action Selection: Exploitation in Root: 376901 Exploration in Root: 70661 Percentage Exploration in Root: 0.15788 Skipped backups: 1457365615 Initializer: ExpandNode Heuristic weight: 1 Number of initial visits: 1 Heuristic: Encountered unknown states: 0 Statistics of DD Heuristic Seach [complete] with IDS: Statistics of IDS: Maximal search depth: 65 Cache hits: 0 Root Node: -12.6492 (in 447566 real visits) Q-Value Estimates: noop() : -12.7691 (in 55680 real visits) roll(d3) : -17.5138 (in 7537 real visits) roll(d2) : -12.6492 (in 376812 real visits) roll(d1) : -17.5721 (in 7537 real visits) Used RAM: 478556 Submitted action: roll(d2) Immediate reward: -1 *********************************************** *********************************************** >>> END OF ROUND 10 -- REWARD RECEIVED: -133 *********************************************** *********************************************** Immediate rewards: Round 0: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -12 Round 1: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -15 Round 2: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -11 Round 3: -1 -1 -1 -1 -1 -1 -1 -1 -1 = -9 Round 4: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -13 Round 5: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -19 Round 6: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -45 Round 7: -1 -1 -1 -1 -1 -1 -1 = -7 Round 8: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -14 Round 9: -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 = -21 >>> TOTAL REWARD: -1009 >>> AVERAGE REWARD: -100.9 *********************************************** PROST complete running time: 183.094s