I think cayenne is excellent for adding heat. As for chile flavor, not so much, especially for long-cooked items. The heat holds but its flavor dissipates, imo. Too, relatively little is used in proportion to the other ingredients. If heat is what is sought it's a good choice, and I use it myself when heat alone is what I seek to increaase. But, often, I'm looking for heat and chile flavor and for that I select chilies with both. If, as in your case, the desire is to taste virtually the same foods as the others you are cooking for, then adding heat via cayenne for your portion is a good way to go. Virtually the only difference will be the heat level.