This could be another thread; if the discussion continues, somebody please do start one.
It doesn't sound to me as though you're sharpening your knives. It sounds as though you're honing them. Honing maintains an edge. It is done with a steel or other rod-like device, whatever that may be made of. Some of these label themselves as sharpeners, but they really aren't all that effective for anything but honing. And honing can only maintain an edge for so long. Even if you hone before every use of the knife, you'll need to sharpen every few months (or more often if you're a heavy user). Here's what a honing device usually looks like:

Sharpening, as the term implies, actually sharpens the edge through grinding the metal. It is done with a sharpening stone; in cases of very dull blades, it needs to be done with a succession of stones beginning with very coarse grit and ending with very fine grit -- and even with a leather strop if you're hardcore. Have you ever used a sharpening stone on your knives? If not, you haven't been sharpening them. Here's what a sharpening stone looks like:

As for basic sharpening-stone technique, it's one of those things that is a lot easier to demonstrate than to describe, but I can get you some references on how best to do it -- or I can try to eke out an explanation myself. But let's establish first of all where you stand in the process.