It sounds like you're an intelligent person, so I'm sure you've done your fair share of research. Are you looking at this from a career standpoint or as a hobby? The paths you can take branch out a quiet a bit, but at the very least I think you should pick up a book about computer science.
You should also make it a goal to further educate yourself with computers. I definitely suggest attempting to build your own computer as well, but nothing super fancy or expensive -- Maybe check garage sales first before you go into building something for performance. Take it apart, know what each part will do, and where and why wires are connected the way they are.
If you are STILL interested in computers at this point after reading on the topic, and using a PC -- then I suggest taking an introduction to Computer Science class at your local junior college OR picking up an intro book to a language. This will give you a good foundation to take off from.
You have to ask yourself, What do you want to do with programming?
Do you want to build desktop applications like microsoft word? Do you want to build video games? Do you want to design websites? Do you just want to Hack stuff?
This is important to know early on because some languages perform better than others at certain tasks. C# can be seen as a lawn mower, while C++ can be seen like a pair of trimmers. You can get a lot done fast with C#, but C++ has a lot more control and precision . But, they definitely both cut grass. You need to also talk to a guidance counsler at your local college too, they can give you a better idea what classes you can take, and what road you should look into. It wouldn't hurt to talk to a few of the computer science instructors as well as the head of the department. Be friends with them, see why they chose the field they did. It's a good way to check if their goals and dreams align with yours.
What you DEFINITLY Dont want to happen is you're 3 years into it and all the sudden you decide that puppies are way better so you change your study half way into the whole thing.
Central Valley Computer Parts
(I was a Technology Instructor at a private college before I work here ^)