It's true that some of their later albums aren't so great... but "Raygun Suitcase" from 1995 might be the best thing they ever did. One of the most underappreciated albums of all time. Also great (and overlooked) is the David Thomas solo album "Erewhon," from around the same period.
I believe Brian Eno said of Pere Ubu "someone has to do the dirty work". Always a fan. "Codex" is a grand number about obsession, dark but super funny as well.
https://youtu.be/9qnRzCWFgd4
"her come my shoes, here comes me,,one,,two,,one"