What you want to do is possible.
In my opinion if you are not familiar with the process start small.
1. Build the database on the Windows Computer with only a few columns,rows, categories.
2. Set user account(s) to access the data in SQLite
3. Try one android device (
locally) within the LAN to see if you can connect edit, add, delete etc.
*Note outside access to the data requires more configuration(i.e port forwarding, possible firewall issues)
That should get you started,
See link for connection steps
http://www.b4x.com/android/forum/th...r-rdc-connect-to-any-remote-db.31540/#content
and
http://www.b4x.com/android/forum/threads/rdc-simple-way-to-create-your-own-back-end-database.31616/
Hope this helps