I was looking at this thread: Mandatory Saving .
And I’ve been thinking about how I can or cannot control my installpv decision. From what I can tell, the experienceasset is very limited in what it can see as far as the action space is concerned. It can see its decision variable (installpv) and its own asset value (solarpv), and of course it can see static values in Params, but it cannot see the housing decisions (buyhouse), so it tries to install PV independently of whether the agent yet owns a house.
I can make the agent reject any state that accumulates solarpv before a house is purchased, but that makes the solarpv asset kind of meaningless.
Alas, I don’t have the credentials needed to access the Zhou paper, so I have only a superficial understanding of what the action space really looks like in that example. But if I do understand correctly, I should ditch the idea of making installpv its own binary decision variable, and consolidate everything into buyhouse where a new value of 5 in a 6-member list could be “installpv in a house that you own”. In which case the experienceasset could test the status of home ownership before deciding to install.