I tried to make an IPA keyboard map myself a while ago, and I found that there were just too many symbols to make everything convenient. So try to come up with some logic that can be easily remembered. For example, maybe place the clicks as secondary characters on the numerals? (Since "!" is already there.)

In the end, I gave up because it was just too crowded to fit all of the symbols, and wasn't saving me time.

What I use to type IPA is this:
http://westonruter.github.io/ipa-chart/keyboard/

My goal in remapping the keyboard was to roughly follow that layout, not the original letters, which seems more confusing if you have a full set of IPA characters. If you're just adding a few for languages you use often, adding them to the existing layout makes a lot of sense. But if it's everything, you might want to start from scratch. One inconvenience I found, though, is that the keys are not in straight columns up and down, and it ended up being more an exercise in trying to fit a square peg into a round hole than actually making something productive (for myself).

In itself, what you've written above sounds fine: there's a pattern to it, so it's easy to remember, and you seem to mostly be mapping based on place of articulation, which makes sense.