I've been teaching myself how to develop websites over the last year or so. Wordpress is a great platform for creating and managing websites, both small and big. There's also a huge online community to help you in your learning process, from the very basics to advanced hacks.
The first and main resource: Google. I've found answered to almost all my questions (how to hack this, how to code this, WTF does this mean, etc?) by simply doing a google search.
Here are a few resources re: Wordpress:
The Wordpress Codex:
http://codex.wordpress.org/
WP Topics (news, tutorials, and influential voices in the WP universe):
http://www.wptopics.com/
Wordpress code snippets:
http://wpsnipp.com/ and
http://wp-snippets.com/
Others:
http://speckyboy.com/,
http://justintadlock.com/
If you're going to work mostly with Wordpress, you'll need to figure out how theme and framework works. Here are some articles to get you started:
http://codex.wordpress.org/Theme_Development,
http://yoast.com/wordpress-theme-anatomy/,
http://codex.wordpress.org/Template_Hierarchy .
Here are two great frameworks to start from:
Reverie (a responsive framework):
http://themefortress.com/reverie/
The _s theme or Thematic by ThemeShaper:
http://themeshaper.com/
My recommendation would be to start by installing Wordpress and familiarizing yourself with the platform. Once you feel comfortable with the user end of it, have a look "under the hood", and inspect the code for Twenty Twelve (WP default theme) to start learning how it works.
If you're going to develop and/or design Wordpress websites, you'll need to learn HTML, CSS, PHP and jQuery. You'll also need to learn to use and administer a database with JQL.
There are tons of resources online to learn.
A general web development resource, with tons of info and tutorials on CSS, HTML, PHP, AJAX, Javascript, jQuery, SQL, etc. :
http://www.w3schools.com/
Introduction to PHP on the official PHP manual site:
http://ca.php.net/manual/en/tutorial.php
Other PHP online resources:
www.zend.com,
www.phpbuilder.com
Code repositories:
www.hotscripts.com/PHP/,
http://php.resourceindex.com,
www.phpclasses.org,
http://px.sklar.com
Not online, but I believe available at the Toronto Public Library (in ebook):
PHP for the Web by Larry Ullman. A great, easy to read, and written in "plain english" introduction to PHP.
For Javascript and jQuery, I've found
Javascript & jQuery: the missing manual, by David Sawyer McFarland to be the best introduction resource. Available at the TO public library, both in hard copy and ebook. Other good books (also available at TPL):
Pro PHP and jQuery,
jQuery in action by Bear Bibeault, Yehuda Katz.
Online:
http://jquery.com/,
http://www.learningjquery.com/
In terms of tools, you'll need a text editor (
Notepad for Window,
TextWrangler for Mac - both open source) and a FTP software (
FileZilla for Windows,
Cyberduck for Mac - also both open source). For development purpose, I recommend installing Wordpress locally. You'll need to install
XAMPP on your computer first. Here are two articles on how to install WP locally:
On a Mac:
http://codex.wordpress.org/Installing_WordPress_Locally_on_Your_Mac_With_MAMP
On Windows:
http://wpmu.org/install-wordpress-locally-on-windows-with-xampp/
For administrating MySQL,
phpMyAdmin (open source).
A great tool to test, save, and share code quickly:
http://jsfiddle.net/
Recommended web hosting services that are very "Wordpress friendly", and with excellent customer services and support (Bell Canada could learn a thing or two from those guys): Bluehost.com and Hostgator.com.
That should get you started. Hope it helps.