A couple of things:
When you say "you close the apps" how are you doing that? Pressing the home button doesn't close them. Android is a multi-tasking OS, and is designed to keep multiple apps in memory. To close an app you need to either (1) select a "quit," "exit" or similar option for the app's menu, or pressing the back button repeatedly until you're back at the home screen. And even that might not close some apps.
Most apps, even if they're "running", aren't really using CPU or battery. They're simply resident in memory, ready in case you want to access them again. If you download the free version of System Panel from the play store, you can see that while there are lots of "active" apps, they're not using any CPU.
But to answer your question, yes. You can check this yourself. When you long press on the home button, notice the menu that appears at the bottom. Click on the pie chart, and it will show you all the apps that are actually running. Now long press the home button again and swipe away one of those active apps, then tap the pie chart again. The app you swyped away should be gone.