You can do that with FTP or SMB. You’ll need to set up an FTP server or enable file sharing on your computer to the folders you would like to share. And then you can access it from your Android with any FTP/SMB clients available from the app store. I’ve used AndSMB client and it does the job! Here is an updated overview on this.
