I recently got into some collage art and have been buying grab bags from record stores for album covers to x-acto elements out of. Figured I might as well scroll though the records themselves before tossing them, and actually ended up finding some fun stuff. These packs are some collections of samples / rips from those rando records, roughly grouped by category. They are relatively unprocessed, other than being normalized, but they sound nice and could be some nice fodder for your sampler. This article by an internet stranger aligns with how I feel about using unlicensed samples.
Samples ripped from dollar bin records. This one has some drums and other rando samples that didn't fit in another category.
Samples ripped from dollar bin records. Some fun 80s vibes, elevator music-core, etc.