We did have about 1/5th of our angel money left when we decided to call it quits. There were a number of reasons for doing so at that time. Primarily, the remaining money would not have gotten us to where we wanted to be and we were not able to raise more money due to our inexperience (first time founders). We did return the remaining amount because that's the right thing to do. No need to burn bridges.
I wonder if there's a more subtle lesson in that story about knowing when to quit.