As I recall, your house is in the country, so your heating options are probably limited. Is a wood stove an option? I also live in the boonies, and I know a lot of people out here heat with wood. If one has access to wood, and the patience to chop/cut/split, wood can even be free.
Even if one pays for wood, my thought is that at least the money is staying local, not to some energy company CEO sitting on beach someplace.
Another thing about wood is that it works when the power fails. I guess I'm getting older too, but after that storm last week, with massive power failures which apparently even included suburban areas, I'm thinking that when I move again one thing on my priority list will be some sort of electricity independent heating system that I can use in emergencies if no other time. Even a fireplace is better than nothing.
Another wood system heating that's a little easier to live with is pellet stoves. A neigbhor who mainly heats with regular wood has a pellet stove, too. It's worked well for him and his wife. (His wife mainly--she apparently doesn't like dealing with regular wood.) I'm not sure about the pellet costs--but it may be cheaper than electricity or propane.
A final option that one of my uncles does and probably would heartily endorse: move to Arizona for the winter!