There is also what Stafford Beer writes about when discussing viable systems - the goal for most organisations, is not their stated goals, but survival and perpetuating the system. The stated goals are a byproduct of that, if and when achieved.i.e. in a lot of universities education is a byproduct, in a lot of hospitals, healthcare is a byproduct, hell in a lot of governments, governance and actually improving things is a byproduct, that will not happen unless there is an absolute need for it...
In a way it's like running a tricky multi-objective optimisation, and the AI will find a way to cheat the stated goal.
In a way it's like running a tricky multi-objective optimisation, and the AI will find a way to cheat the stated goal.