Qlearning robot - Revision history

Greg at 05:26, 12 November 2018

2018-11-12T05:26:53Z

2018-08-30T03:40:48Z

2018-05-03T18:30:57Z

Required, Allowed & Prohibited

2018-04-02T22:34:00Z

Template and Data

2018-04-02T22:33:40Z

Draft: Draft is now finalized.

2018-01-26T21:38:31Z

Template and Data: Changed zip file link media->file to make it easier to see when changes occur

2018-01-19T21:56:51Z

Template and Data: warning

2018-01-14T21:37:34Z

Finalized

2017-11-13T21:45:41Z

Hints & resources

2017-11-13T21:40:36Z

Hints & resources

@@ Line 142: / Line 142: @@
 ==Part 4: Implement author() Method (up to 20 point penalty)==
-You  should implement a method called <tt>author()</tt> that returns your Georgia Tech user ID as a string. This is the ID you use to log into t-square.  It is not your 9 digit student number.  Here is an example of how you might implement author() within a learner object:
+You  should implement a method called <tt>author()</tt> that returns your Georgia Tech user ID as a string. This is the ID you use to log into canvas.  It is not your 9 digit student number.  Here is an example of how you might implement author() within a learner object:
 <pre>
@@ Line 177: / Line 177: @@
 ==What to turn in==
-Turn your project in via t-square.   All of your code must be contained within QLearner.py .
+Turn your project in via canvas.   All of your code must be contained within QLearner.py .
 * Your QLearner as <tt>QLearner.py</tt>

@@ Line 17: / Line 17: @@
 ==Template and Data==
-* Download the template code here: [[File:qlearning_robot.zip]]
+* Download the template code here: [[File:18fall_qlearning_robot.zip]]
 * Implement the <tt>QLearner</tt> class in <tt>qlearning_robot/QLearner.py</tt>.
 * To debug your Q-learner, run <tt>'''python testqlearner.py'''</tt> from the <tt>qlearning_robot/</tt> directory. The grading script for this project is <tt>'''grade_robot_qlearning.py'''</tt>.

@@ Line 229: / Line 229: @@
 * Your code may use standard Python libraries.
 * You may use the NumPy, SciPy, matplotlib and Pandas libraries.  Be sure you are using the correct versions.
 * Code provided by the instructor, or allowed by the instructor to be shared.
 Prohibited:
 * Any libraries not listed in the "allowed" section above.
-* Any code you did not write yourself (except for the 5 line rule in the "allowed" section).
+* Any code you did not write yourself.
 * Any Classes (other than Random) that create their own instance variables for later use (e.g., learners like kdtree).
 * Print statements outside "verbose" checks (they significantly slow down auto grading).

@@ Line 17: / Line 17: @@
 ==Template and Data==
-* Download the template code here: [[File:qlearning_robot.zip]]  (<span style="color:red">This file is for Fall 2017 and will be updated for the current semester</span>)
+* Download the template code here: [[File:qlearning_robot.zip]]
 * Implement the <tt>QLearner</tt> class in <tt>qlearning_robot/QLearner.py</tt>.
 * To debug your Q-learner, run <tt>'''python testqlearner.py'''</tt> from the <tt>qlearning_robot/</tt> directory. The grading script for this project is <tt>'''grade_robot_qlearning.py'''</tt>.

← Older revision		Revision as of 22:33, 2 April 2018
Line 1:		Line 1:
−	==~~Draft~~==	+	==Finalized==
−
−	~~This project is in draft mode. When it is finalized, this notice will be removed.~~

	==Overview==		==Overview==

@@ Line 1: / Line 1: @@
-==Finalized==
+==Draft==
-This assignment has been finalized.
+This project is in draft mode.  When it is finalized, this notice will be removed.
 ==Overview==

@@ Line 174: / Line 174: @@
 For implementing Dyna, you may find the following resources useful:
-* https://webdocs.cs.ualberta.ca/~sutton/book/ebook/node96.html
+* http://www-anw.cs.umass.edu/~barto/courses/cs687/Chapter%209.pdf (Section 8.2)
 * http://incompleteideas.net/sutton/book/bookdraft2017nov5.pdf