Those are likely Asian Beetles (often called lady bugs). Most people can't tell the difference between them, but if the windows are infested, then it's a safe bet they are the Asian Beetles.

Similar to lady bugs, they both prey on aphids. The little bit of research I've done suggests that you can't actually "get rid of them" but there are things you can do to help control their migration. Things like good window weather stripping etc. But I'm assuming they are already in the house...

What I've done in the past is suck them up in the vacuum with the hose, and then dump them outside. (Use a fresh collection bag) I've seen someone suggest using a leg nylon to collect them. Just attach it with a rubber band or something.