Difference between revisions of "ML4T Software Installation"

From Quantitative Analysis Software Courses
Jump to navigation Jump to search
m
(2 intermediate revisions by the same user not shown)
Line 7: Line 7:
  
 
==Overview==
 
==Overview==
 +
 +
===Important notes===
 +
 +
* We use a specific, static dataset for this course, which we will provide. If you download your own data from Yahoo (or elsewhere), you will get wrong answers on assignments.
 +
* While these instructions should work for either Windows, macOS, or Linux, we '''strongly recommend''' developing on recent versions of Ubuntu LTS, as there may be significant differences on Windows. You can easily create an Ubuntu based virtual machine image to develop on using any freely available VM software (VirtualBox is probably the easiest and cheapest).
 +
* Regardless of your OS and install method, you should still ensure that your code runs on the provided servers. If your code fails to run on the servers, "it works on my machine" is not a valid excuse, and '''you will receive no credit'''.
  
 
The assignments in this class are in Python (version 2.7), and rely heavily on a few important libraries. These libraries are under active development, which unfortunately means there can be some compatibility issues between versions. This isn't an issue if you use the provided servers, but if you want to work from your local machine it is very important to make sure you have exactly the same library versions. To that end, here is a list of each library and its version number, provided in the pip freeze format:
 
The assignments in this class are in Python (version 2.7), and rely heavily on a few important libraries. These libraries are under active development, which unfortunately means there can be some compatibility issues between versions. This isn't an issue if you use the provided servers, but if you want to work from your local machine it is very important to make sure you have exactly the same library versions. To that end, here is a list of each library and its version number, provided in the pip freeze format:
Line 24: Line 30:
 
   subprocess32==3.2.7
 
   subprocess32==3.2.7
  
If you are familiar with <code>pip</code> and <code>virtualenv</code> you can use this to create a virtualenv for this class which matches those version numbers. If not, this script should accomplish the same thing: [[File:ml4t-setup.py]]. The script will install <code>virtualenv</code> using <code>pip</code>, create a virtual environment in the current directory named <tt>ml4t-venv</tt>, and use <code>pip</code> to install the library versions listed above into that virtual environment. It requires [https://pypi.python.org/pypi/pip pip] which is provided by default on both macOS and Ubuntu, and comes packaged with the standard Python install for Windows. Certain backends for matplotlib may require additional libraries be installed in a platform specific way(on Ubuntu, <code>sudo apt install python-tk</code> should do the trick). You can read the documentation for <code>pip</code> and <code>virtualenv</code> here:
+
If you are familiar with <code>pip</code> and <code>virtualenv</code> you can use this to create a virtualenv for this class which matches those version numbers. Here is an outline:
 +
 
 +
# Install virtualenv (if it is not already installed): <code>python -m pip install --user virtualenv</code>
 +
# Create a viritual environment for this class: <code>virtualenv ml4t-venv</code>
 +
# Activate the new virtual environment: <code>source ml4t-venv/bin/activate</code> on Linux or macOS, <code>ml4t-venv/Scripts/activate.bat</code> on Windows.
 +
# Save the above list as a text file, say <tt>ml4t-libraries.txt</tt>
 +
# Install the libraries using the requirements file you just saved: <code>python -m pip install --requirement ml4t-libraries.txt</code>
 +
 
 +
This will install <code>virtualenv</code> using <code>pip</code>, create a virtual environment in the current directory named <tt>ml4t-venv</tt>, and use <code>pip</code> to install the library versions listed above into that virtual environment. It requires [https://pypi.python.org/pypi/pip pip] which is provided by default on both macOS and Ubuntu, and comes packaged with the standard Python install for Windows. Certain backends for matplotlib may require additional libraries be installed in a platform specific way (on Ubuntu, <code>sudo apt install python-tk</code> should do the trick). More information on each of the tools mentioned on this page can be found here:
 
* [https://virtualenv.pypa.io/en/stable/userguide/#usage virtualenv]
 
* [https://virtualenv.pypa.io/en/stable/userguide/#usage virtualenv]
 
* [https://pip.pypa.io/en/stable/ pip]
 
* [https://pip.pypa.io/en/stable/ pip]
 
'''Important note''': We use a specific, static dataset for this course, which we will provide. If you download your own data from Yahoo (or elsewhere), you will get wrong answers on assignments.
 
  
 
== Optional software ==
 
== Optional software ==
Line 34: Line 46:
 
* IPython [[http://docs.python-guide.org/en/latest/scenarios/scientific/ link]]
 
* IPython [[http://docs.python-guide.org/en/latest/scenarios/scientific/ link]]
 
* A Python IDE, such as [https://www.jetbrains.com/pycharm/ PyCharm] or [https://pythonhosted.org/spyder/ Spyder]
 
* A Python IDE, such as [https://www.jetbrains.com/pycharm/ PyCharm] or [https://pythonhosted.org/spyder/ Spyder]
 +
* [https://www.virtualbox.org/ VirtualBox]

Revision as of 19:10, 22 August 2017

Draft

This page is being updated for the Fall 2017 semester, and is currently in draft mode. This notice will be removed once this page has been finalized.

Attention

The information on this page is for those who are interested to have a Python development environment on their own machine. Keep in mind that even if you set up your own environment, your code still MUST run correctly on the GT servers, so it is very important that you ensure that you have access to them. Please see ML4T_Software_Setup for information on how to use those servers, and how to check out the code scaffolding for the projects.

Overview

Important notes

  • We use a specific, static dataset for this course, which we will provide. If you download your own data from Yahoo (or elsewhere), you will get wrong answers on assignments.
  • While these instructions should work for either Windows, macOS, or Linux, we strongly recommend developing on recent versions of Ubuntu LTS, as there may be significant differences on Windows. You can easily create an Ubuntu based virtual machine image to develop on using any freely available VM software (VirtualBox is probably the easiest and cheapest).
  • Regardless of your OS and install method, you should still ensure that your code runs on the provided servers. If your code fails to run on the servers, "it works on my machine" is not a valid excuse, and you will receive no credit.

The assignments in this class are in Python (version 2.7), and rely heavily on a few important libraries. These libraries are under active development, which unfortunately means there can be some compatibility issues between versions. This isn't an issue if you use the provided servers, but if you want to work from your local machine it is very important to make sure you have exactly the same library versions. To that end, here is a list of each library and its version number, provided in the pip freeze format:

 cycler==0.10.0
 functools32==3.2.3.post2
 matplotlib==2.0.2
 numpy==1.13.1
 pandas==0.20.3
 py==1.4.34
 pyparsing==2.2.0
 pytest==3.2.1
 python-dateutil==2.6.1
 pytz==2017.2
 scipy==0.19.1
 six==1.10.0
 subprocess32==3.2.7

If you are familiar with pip and virtualenv you can use this to create a virtualenv for this class which matches those version numbers. Here is an outline:

  1. Install virtualenv (if it is not already installed): python -m pip install --user virtualenv
  2. Create a viritual environment for this class: virtualenv ml4t-venv
  3. Activate the new virtual environment: source ml4t-venv/bin/activate on Linux or macOS, ml4t-venv/Scripts/activate.bat on Windows.
  4. Save the above list as a text file, say ml4t-libraries.txt
  5. Install the libraries using the requirements file you just saved: python -m pip install --requirement ml4t-libraries.txt

This will install virtualenv using pip, create a virtual environment in the current directory named ml4t-venv, and use pip to install the library versions listed above into that virtual environment. It requires pip which is provided by default on both macOS and Ubuntu, and comes packaged with the standard Python install for Windows. Certain backends for matplotlib may require additional libraries be installed in a platform specific way (on Ubuntu, sudo apt install python-tk should do the trick). More information on each of the tools mentioned on this page can be found here:

Optional software