When it comes to combining samples, I feel like the key isn't nessecarily the problem (because you can adjust it). But more chords they used (major, minor) or a bassline or scale that doesn't fit. With filter work you can kind of work around this 'issue'.
But like you said, when combining...