I have both of those and think they are great. I really enjoy the theme and feeling the TOR evokes but find some of the rules hard to remember. And I really do everything in my power to keep the rulebook off the table during play. Means I need to keep tracking extra currencies or stats to the bare minimum.
I think you could accumulate Exhaustion and then do something simple. Like -1 all effort, -2 all effort, -3 etc. Not sure if I’d want a chart or to do extra math - but jf that’s your think a chart with different stages like that might work. You could also lose inventory spaces or bonus Grit dice if you use those.