From 6.034 Wiki

Revision as of 07:17, 4 November 2015 (view source) Jmn (Talk | contribs) (→Support Vector Machines) ← Previous diff		Revision as of 17:44, 4 November 2015 (view source) Ryanalex (Talk | contribs) (→Helper functions) Next diff →
Line 18:		Line 18:
	=== Helper functions ===		=== Helper functions ===
-	stairstep	+	<tt>stairstep</tt>: Computes the output of the stairstep function using the given threshold
-	sigmoid	+	<tt>sigmoid</tt>: Computes the output of the sigmoid function using the given steepness and midpoint
-	accuracy	+	<tt>accuracy</tt>: Computes accuracy using desired_output and actual_output. If the output is binary, the accuracy ranges from -0.5 to 0
	=== Wiring a neural net ===		=== Wiring a neural net ===

---

Revision as of 17:44, 4 November 2015

Contents 1 Problems 1.1 Neural Nets 1.1.1 Helper functions 1.1.2 Wiring a neural net 1.1.3 Forward propagation 1.1.4 Backward propagation 1.2 Support Vector Machines 1.2.1 Vector Math 1.2.2 5 Equations 1.2.3 Classification Accuracy 1.3 Survey 2 API 2.1 Neural Nets 2.1.1 Wire 2.1.2 NeuralNet 2.2 Support Vector Machines 2.2.1 Point 2.2.2 DecisionBoundary 2.2.3 SupportVectorMachine 2.2.4 Helper functions for vector math

This lab is due by TODO at 10:00pm.

To work on this lab, you will need to get the code, much like you did for the first two labs.

• You can view the files at: http://web.mit.edu/6.034/www/labs/lab6/
• Download it as a ZIP file: http://web.mit.edu/6.034/www/labs/lab6/lab6.zip
• Or, on Athena, add 6.034 and copy it from /mit/6.034/www/labs/lab6/.

Your answers for this lab belong in the main file lab6.py.

Problems

Neural Nets

TODO: explain each function below (basically copy docstrings from lab file, then format)

Helper functions

stairstep: Computes the output of the stairstep function using the given threshold

sigmoid: Computes the output of the sigmoid function using the given steepness and midpoint

accuracy: Computes accuracy using desired_output and actual_output. If the output is binary, the accuracy ranges from -0.5 to 0

Wiring a neural net

TODO (this section will probably be cut, or maybe changed to just specifying number of neurons per layer)

Forward propagation

forward_prop

Backward propagation

update_weights

back_prop

Support Vector Machines

TODO describe functions below (basically copy docstrings and reformat)

Vector Math

norm

dot_product

5 Equations

1. todo also include the 5 equations here so students can refer to them

positiveness

classify

margin_width

check_gutter_constraint

check_alphas

Classification Accuracy

count_misclassified_training_points

Survey

Please answer these questions at the bottom of your lab6.py file:

• NAME: What is your name? (string)

• COLLABORATORS: Other than 6.034 staff, whom did you work with on this lab? (string, or empty string if you worked alone)

• HOW_MANY_HOURS_THIS_LAB_TOOK: Approximately how many hours did you spend on this lab? (number or string)

• WHAT_I_FOUND_INTERESTING: Which parts of this lab, if any, did you find interesting? (string)

• WHAT_I_FOUND_BORING: Which parts of this lab, if any, did you find boring or tedious? (string)

• (optional) SUGGESTIONS: What specific changes would you recommend, if any, to improve this lab for future years? (string)

(We'd ask which parts you find confusing, but if you're confused you should really ask a TA.)

When you're done, run the online tester to submit your code.

API

Neural Nets

The file neural_net_api.py defines the Wire and NeuralNet classes, described below.

Wire

TODO

NeuralNet

TODO

Support Vector Machines

The file svm_api.py defines the Point, DecisionBoundary, and SupportVectorMachine classes, as well as some helper functions for vector math, all described below.

Point

TODO

DecisionBoundary

TODO

SupportVectorMachine

TODO

Helper functions for vector math

TODO add docstrings + format

vector_mult

scalar_add