Submission limit

Another reason why the submission should be increased (maybe to 10-20) is because of errors while submitting, as inference failed errors still count as a submission.

View post 0

Mismatch in limits of observation space for CARTPOLE and MOUNTAINCAR

Hi, when using the command “env.observation_space.high” and “env.observation_space.low” for the above-mentioned two environments, it shows + \infty and - \infty respectively for all elements.

Does this mean that we just hardcode the limits (from the given table) for the two environments or will this issue be corrected, please do let us know!

In addition, when sampling the next state through env.step(), the value for theta_dot exceeds 5.

View post 0

Unable to submit post 20th april

Hi, it looks like a lot of us are unable to perform a submission post 20th. It says “Error in notifying rails about the uploaded file”. Please look into it as the deadline has been pushed to 24th.

View post 1

Any questions about this assignment? Ask them here!

Yes I understand, however I was trying to narrow down the problem as to where the ‘inference failed’ error was popping up. It pops up when I call the function dp_solve with a modified class object.

View post 0

Any questions about this assignment? Ask them here!

Hi, so there is an issue regarding inference failed. If i call the function dp_solve(env2) on another variation of the env object (such as chaning the policy), this is resulting in an inference failed error. Please look into this s it can be fixed, also if possible, please increase the number of submissions for the day cause most of my submissions went to waste for debugging.

View post 0

Reducing tolerance for value grid, please resubmit your code

im having the same issue, please let us know what is the scoring criteria

View post 0

Any questions about the assignment? Ask them here!

Ok will make sure, also when you earlier said that the tolerance was 1e-8, did you mean the matrix norm ( || J_{i+1} - J_i|| ) or the max abs ( \max_{s \in S} |J_{i+1}(s) - J_i(s)| )? Thank you!

View post 0

Any questions about the assignment? Ask them here!

Hi, the env params loaded in the notebook dont seem to correlate to the grid world 1 figure. The co-ordinates in the notebook are transposed, for instance, env.brown_out = (9,7) (i.e. 10th row, 8th column visually) and should be instead (7,9) to match figure 1.

However this doesnt affect the code, it may be an issue in Task 5 where we need to compare and contrast these 2 grid worlds. Please clarify this discrepancy, thank you!

View post 0