verve::TDConnection Class Reference

A Connection that is trainable via temporal difference learning. More...

#include <TDConnection.h>

Inheritance diagram for verve::TDConnection:

List of all members.

Public Member Functions
VERVE_DECL	TDConnection (Neuron *preNeuron, Neuron *postNeuron, TDConnectionType type)
virtual VERVE_DECL	~TDConnection ()
virtual VERVE_DECL TDConnectionType VERVE_CALL	getTDConnectionType ()
virtual VERVE_DECL void VERVE_CALL	increaseETrace ()
virtual VERVE_DECL void VERVE_CALL	decayETrace ()
virtual VERVE_DECL void VERVE_CALL	setETraceDecayFactor (real value)
virtual VERVE_DECL void VERVE_CALL	setTDDiscountFactor (real value)
virtual VERVE_DECL void VERVE_CALL	setETrace (real trace)
virtual VERVE_DECL real VERVE_CALL	getETrace () const
virtual VERVE_DECL void VERVE_CALL	resetShortTermMemory ()
virtual VERVE_DECL void VERVE_CALL	applyTDLearning (real learningFactorTimesTDError)
virtual VERVE_DECL void VERVE_CALL	setIsInActiveList (bool inList)
virtual VERVE_DECL bool VERVE_CALL	isInActiveList ()
Protected Attributes
real	mETrace
TDConnectionType	mTDConnectionType
real	mETraceDecayFactor
real	mTDDiscountFactor
bool	mIsInActiveList

---

Detailed Description

A Connection that is trainable via temporal difference learning.

Definition at line 44 of file TDConnection.h.

---

Constructor & Destructor Documentation

verve::TDConnection::TDConnection (  Neuron *  preNeuron, Neuron *  postNeuron, TDConnectionType  type )

Definition at line 29 of file TDConnection.cpp. References mETrace, mETraceDecayFactor, mIsInActiveList, mTDConnectionType, and mTDDiscountFactor.

verve::TDConnection::~TDConnection (   )  [virtual]

Deallocates any dynamically allocated memory. This object should never be destroyed by the user calling 'delete' because memory allocated within the DLL should also be destroyed within the DLL. Definition at line 41 of file TDConnection.cpp.

---

Member Function Documentation

void verve::TDConnection::applyTDLearning (  real  learningFactorTimesTDError  )  [virtual]

Allows temporal difference learning to occur. Definition at line 121 of file TDConnection.cpp. References verve::Connection::addToWeight(), and mETrace.

void verve::TDConnection::decayETrace (   )  [virtual]

Decays the eligibility trace according to the decay factor. Definition at line 115 of file TDConnection.cpp. References mETrace, mETraceDecayFactor, and mTDDiscountFactor.

real verve::TDConnection::getETrace (   )  const [virtual]

Returns the current eligibility trace. Definition at line 57 of file TDConnection.cpp. References mETrace.

TDConnectionType verve::TDConnection::getTDConnectionType (   )  [virtual]

Returns the type of TDConnection. Definition at line 62 of file TDConnection.cpp. References mTDConnectionType.

void verve::TDConnection::increaseETrace (   )  [virtual]

Increases the eligibility trace if the Connection is "active.". Eligibility depends on the amount of pre-synaptic activity. Eligibility depends on both pre- and post-synaptic activity. Definition at line 77 of file TDConnection.cpp. References verve::Neuron::getFiringRate(), mETrace, verve::Connection::mPostNeuron, verve::Connection::mPreNeuron, mTDConnectionType, verve::POLICY_TDCONNECTION, and verve::VALUE_FUNCTION_TDCONNECTION.

bool verve::TDConnection::isInActiveList (   )  [virtual]

Returns whether the TDConnection is in the ActiveTDConnectionList. Definition at line 131 of file TDConnection.cpp. References mIsInActiveList. Referenced by verve::ActiveTDConnectionList::addNewActiveConnection().

void verve::TDConnection::resetShortTermMemory (   )  [virtual]

Overridden to reset the eligibility trace in addition to other STM parameters. Reimplemented from verve::Connection. Definition at line 45 of file TDConnection.cpp. References mETrace, mIsInActiveList, and verve::Connection::resetShortTermMemory().

void verve::TDConnection::setETrace (  real  trace  )  [virtual]

Sets the eligibility trace. Definition at line 52 of file TDConnection.cpp. References mETrace.

void verve::TDConnection::setETraceDecayFactor (  real  value  )  [virtual]

Sets the factor that determines how fast the eligibility trace decays. Definition at line 67 of file TDConnection.cpp. References mETraceDecayFactor. Referenced by verve::TDProjection::connectNeurons().

void verve::TDConnection::setIsInActiveList (  bool  inList  )  [virtual]

Sets whether the TDConnection is in the ActiveTDConnectionList. Definition at line 126 of file TDConnection.cpp. References mIsInActiveList.

void verve::TDConnection::setTDDiscountFactor (  real  value  )  [virtual]

Sets the factor that determines how much future rewards are discounted. Definition at line 72 of file TDConnection.cpp. References mTDDiscountFactor. Referenced by verve::TDProjection::connectNeurons().

---

Member Data Documentation

real verve::TDConnection::mETrace [protected]

The decaying trace of eligibility. The higher this value, the more the weight can be changed. Definition at line 97 of file TDConnection.h. Referenced by applyTDLearning(), decayETrace(), getETrace(), increaseETrace(), resetShortTermMemory(), setETrace(), and TDConnection().

real verve::TDConnection::mETraceDecayFactor [protected]

Determines how fast the eligibility trace decays. Definition at line 103 of file TDConnection.h. Referenced by decayETrace(), setETraceDecayFactor(), and TDConnection().

bool verve::TDConnection::mIsInActiveList [protected]

This is set to true when the TDConnection is added to the ActiveTDConnectionList. Definition at line 110 of file TDConnection.h. Referenced by isInActiveList(), resetShortTermMemory(), setIsInActiveList(), and TDConnection().

TDConnectionType verve::TDConnection::mTDConnectionType [protected]

The type of TDConnection. Definition at line 100 of file TDConnection.h. Referenced by getTDConnectionType(), increaseETrace(), and TDConnection().

real verve::TDConnection::mTDDiscountFactor [protected]

Determines how much future rewards are discounted. Definition at line 106 of file TDConnection.h. Referenced by decayETrace(), setTDDiscountFactor(), and TDConnection().

---

The documentation for this class was generated from the following files:

• TDConnection.h
• TDConnection.cpp

---