Nah, kids aren't the problem. I've had a lot of fun playing WoW, 7 Days to Die, Forza, Terraria, Minecraft, and many, many other games with my kids (I have 5). You may need to change up what you are playing, is all.
Just be ready, the game starts very slowly, so you need to stick with it. I had 2 or 3 false starts before I finally was able to stick with it, and I have now played through all 4 Mass Effect games and love them (other than Andromeda, which I just like).