Hey, so I decided to check the various ways to download files from Mystic
after upgrading a few times since I turned it on.

Zmodem is fine; FTP is fine, but there's a potential issue I'll tell you
about in a sec. HTTP doesn't work.

It balked in the Mystic MIS window at first because it didn't find a favicon.ico, which I rememdied. Not sure if it would have caused a download
to abort or not.

Afterwards, all the browser window shows is the number 1 in the top left corner. Checking the source, it shows four blank lines, the number 1, then another blank line. Doesn't matter the file to download, it always just shows that 1.

The MIS window is showing everything is working correctly. Authenticated user is correct, getting the browser stuff okay. But all it shows is that 1.
Thought maybe it was showing the number of files queued, but nope, multiple files queued, different files, all show that 1.

FTP dl link is fine, but it also lets you browse the parent directory. Not
sure if that's intended, and it's not an issue with me because I have my file bases setup correctly, but it might be an issue with those that don't, or
those with limited bandwidth.

--- Mystic BBS v1.12 A44 2020/02/04 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

Hey, so I decided to check the various ways to download files from Mystic after upgrading a few times since I turned it on.

Zmodem is fine; FTP is fine, but there's a potential issue I'll tell you about in a sec. HTTP doesn't work.

You need to have the web-UI templates and configurations for that which I've never released. Let me throw you a bone :)

Go download dlreq.zip from the Prealpha folder and drop the template files inside into the "cfg" directory off of your webroot.

So if your webroot is /mystic/webroot you'd make a /mystic/webroot/cfg and
then drop the template files in there.

Then try it again. I *think* thats the minimum templates you need for that part of the web UI.

--- Mystic BBS v1.12 A45 2020/02/11 (Linux/64)
* Origin: Sector 7 (21:1/108)

FTP dl link is fine, but it also lets you browse the parent directory.
Not sure if that's intended, and it's not an issue with me because I
have my file bases setup correctly, but it might be an issue with those that don't, or those with limited bandwidth.

Forgot to respond to this part in my last message.

For the FTP part, if you don't have Anonymous enabled then the user must login to the FTP server in which case they will have access to the FTP site as they normally would with their user account. It will just default them into a directory with their queued files all in there, but they can leave it if they choose.

If you have anonymous enabled they can hit the DL queue without needing to login (it will SSO them in) but their access will be limited to only what you have configured to be accessible via Anonymous FTP.

I think it will still show the other file base directories but if you tried
to switch to them as Anonymous without Anonymous access enabled it should
give you an error. I probably should change it so you can't even see the directories though. Let me make a note of that.

--- Mystic BBS v1.12 A45 2020/02/11 (Linux/64)
* Origin: Sector 7 (21:1/108)

Then try it again. I *think* thats the minimum templates you need for that part of the web UI.

Hey g00, I'd like to host some mystic web stuff but gate it behind nginx. I haven't touched any of this yet, frankly, so am just shooting in the dark
here, but I'm curious how far you've gone down the web trail so far and if
this is a supported way of doing business, or if mystic is expected to be
able to listen on the open internet for http requests?

--- Mystic BBS v1.12 A44 2020/02/04 (Linux/64)
* Origin: monterey bbs (21:1/168)

Hey g00, I'd like to host some mystic web stuff but gate it behind
nginx. I haven't touched any of this yet, frankly, so am just shooting
in the dark here, but I'm curious how far you've gone down the web trail so far and if this is a supported way of doing business, or if mystic is expected to be able to listen on the open internet for http requests?

Mystic's web server is very basic. Its using HTTP 1.0 which may or may not be a deal breaker with a reverse proxy in the mix. I can't think of a reason why it wouldn't work, but it may come down to the specific reverse proxy and whether or not it requires use of 1.1 features (like keep-alive or something).

If for some reason it won't work, we can try to make it so it does though.

My own experiences using the server has been for the file area queue downloading and for hosting a mysticbbs.com mirror for a short while when we hit bandwidth capacity with the provider, and none of those have been proxied.

--- Mystic BBS v1.12 A45 2020/02/11 (Linux/64)
* Origin: Sector 7 (21:1/108)

On 12 Feb 2020, g00r00 said the following...

You need to have the web-UI templates and configurations for that which I've never released. Let me throw you a bone :)

Thaaaaaat might be why! haha

Go download dlreq.zip from the Prealpha folder and drop the template
files inside into the "cfg" directory off of your webroot.

Done, and done. Going to check it out now. Thanks!

--- Mystic BBS v1.12 A45 2020/02/12 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

It generates the page like it's supposed to, which is awesome!

BUT! Every file tried says, "An error occurred while processing your file download request.

Reason: File not found in database"

Which is malarkey. =) I was able to view every file I tried downloading
inside Mystic afterwards.

I thought it might be a misconfiguration on my part for the file bases, but they all look okay.

--- Mystic BBS v1.12 A45 2020/02/12 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

BUT! Every file tried says, "An error occurred while processing your file download request.

Reason: File not found in database"

I'm not sure what could be different. I just tested it in Ubuntu 18 and Windows 10 and its working on both of them for me.

13:02:51 HTTP 1-DLREQ: 01b31a92&mystic.mem 13:02:51 HTTP 1-Authenticated user: g00r00
13:02:51 HTTP 1-Download from Batch: mystic.mem
13:02:51 HTTP 1-Request done

--- Mystic BBS v1.12 A45 2020/02/11 (Linux/64)
* Origin: Sector 7 (21:1/108)

On 13 Feb 2020, g00r00 said the following...

BUT! Every file tried says, "An error occurred while processing your download request.

Reason: File not found in database"

I'm not sure what could be different. I just tested it in Ubuntu 18 and Windows 10 and its working on both of them for me.

I'm not sure, either. Mystic tells me the same thing that the browser does, "Refused: file not found in database". Which is weird, because all other methods work just fine.

I thought maybe it was because I had port range forwarding instead of single, since I'm out of room for single, but I just tried it and it's the same.

Maybe a directory wasn't created/moved in the various upgrades? I'm not sure how the temp HTTP downloading works, if it creates a temp directory for the downloads, or if it links directly to the files in the file bases config. I'm going to assume the latter, since FTP seems to work by directly linking to
the file location.

My BBS is off the root file system, as /mystic and so are the file
directories, /bbs_files, not sure if that would be an issue? All permissions are set correctly, ownership, etc. The only thing is I'm not running Mystic
as su, it's owned by my account with the setcap 'cap_net_bind_service=+ep' dealy. I'm gonna try running Mystic as su to see if that affects anything.

--- Mystic BBS v1.12 A45 2020/02/12 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

Yeah, that didn't make a difference. I'm thinking it's something that got
lost or misconfigured via various upgrades, something I did wrong. I have no idea what it would be.

--- Mystic BBS v1.12 A45 2020/02/12 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

Yeah, that didn't make a difference. I'm thinking it's something that got lost or misconfigured via various upgrades, something I did wrong. I
have no idea what it would be.

I'm not so sold on that being the case either, but I can't really think of a cause at the moment.

You said you are able to view the contents of the same file in Mystic that you can't download via the web right?

--- Mystic BBS v1.12 A45 2020/02/11 (Linux/64)
* Origin: Sector 7 (21:1/108)

On 13 Feb 2020, g00r00 said the following...

Yeah, that didn't make a difference. I'm thinking it's something that lost or misconfigured via various upgrades, something I did wrong. I have no idea what it would be.

I'm not so sold on that being the case either, but I can't really think
of a cause at the moment.

You said you are able to view the contents of the same file in Mystic
that you can't download via the web right?

Yep. The files are there, I even checked the location of said files. Editing the files in Mystic let me view the contents, and also read any text files in those same archives.

Like I said, it works for Zmodem and FTP, no issues. It's just the HTTP
that's boning me.

If you want to poke around the BBS machine, maybe see something I'm missing, I'm game if you are. Email me for the VNC info if you like, sysop [at] throwbackbbs.com [dot] com.

--- Mystic BBS v1.12 A45 2020/02/12 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

I'm not sure what could be different. I just tested it in Ubuntu 18 and Windows 10 and its working on both of them for me.

13:02:51 HTTP 1-DLREQ: 01b31a92&mystic.mem 13:02:51 HTTP 1-Authenticated user: g00r00
13:02:51 HTTP 1-Download from Batch: mystic.mem
13:02:51 HTTP 1-Request done

I've also tried to get the HTTP download working some time ago without
success. Finally decided to make my own HTTP downloader which has been
working flawless since.

The other driver for making it was so I could throttle download bandwidth and avoid large downloads to degrade the experience of the other connected users.

Cheers!

|15 ▀ ▐ |15StackFault |08<|03.|11.|15P|11h|03EN|11o|15M|11.|03.|08>
|11 ▌ ▀ |11The Bottomless Abyss BBS
|03 ▀ ▌▀ |03ssh|08.|072222 |08/ |03telnet|08.|072023 |08/ |03https
|08 ▄■▐ |08bbs|07.|08bottomlessabyss|07.|08net

--- Mystic BBS v1.12 A43 2019/03/02 (Linux/64)
* Origin: The Bottomless Abyss BBS * bbs.bottomlessabyss.net (21:1/172)

I've also tried to get the HTTP download working some time ago without success.

You would have needed to have the web UI templates installed for that function, which I doubt you did because I don't think I ever released them for the HTTP server downloads. :)

--- Mystic BBS v1.12 A45 2020/02/13 (Windows/64)
* Origin: Sector 7 (21:1/108)

I've also tried to get the HTTP download working some time ago withou success.

You would have needed to have the web UI templates installed for that function, which I doubt you did because I don't think I ever released
them for the HTTP server downloads. :)

I'll take a look at the templates you put out couple days ago.

I may be good to retain my throttling by reverse proxying the flows thru
NGINX.

Cheers!

|15 ▀ ▐ |15StackFault |08<|03.|11.|15P|11h|03EN|11o|15M|11.|03.|08>
|11 ▌ ▀ |11The Bottomless Abyss BBS
|03 ▀ ▌▀ |03ssh|08.|072222 |08/ |03telnet|08.|072023 |08/ |03https
|08 ▄■▐ |08bbs|07.|08bottomlessabyss|07.|08net

--- Mystic BBS v1.12 A43 2019/03/02 (Linux/64)
* Origin: The Bottomless Abyss BBS * bbs.bottomlessabyss.net (21:1/172)

I just tried the Http process to download files. I dropped those zip files into the folder as you mentioned earlier. I think I see the issue, but do
not know the solution.

My URL to the files had the port address for telnetting into my BBS, as well as the http address:

Something like http://9640news.ddns.net:9640:8080/directoryname

It looks like it was doubling up on the port.

Beery

--Beery Miller -- 9640 News BBS -- 9640news.ddns.net:9640 --

--- Mystic BBS v1.12 A44 2020/02/04 (Windows/64)
* Origin: 9640 News BBS (21:4/109)

On 14 Feb 2020, Beery said the following...

I just tried the Http process to download files. I dropped those zip files into the folder as you mentioned earlier. I think I see the
issue, but do not know the solution.

My URL to the files had the port address for telnetting into my BBS, as well as the http address:

Something like http://9640news.ddns.net:9640:8080/directoryname

You must have the port entered in Servers > General Options > Domain Name.
Take that out, it should give you a proper URL.

Wish my issue were that easy to figure out. =)

--- Mystic BBS v1.12 A45 2020/02/12 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

I just tried the Http process to download files. I dropped those zip files into the folder as you mentioned earlier. I think I see the
issue, but do not know the solution.

My URL to the files had the port address for telnetting into my BBS, as well as the http address:

Something like http://9640news.ddns.net:9640:8080/directoryname

It looks like it was doubling up on the port.

What do you have set for your "BBS Domain" in your server general settings? My guess is that you may have your port included in that. It should only be the Domain name and if you include the port there it will end up breaking a bunch of things (Email, FTP server passive functions, HTTP downloads, and so on).

Let me know if that is it or if we need to dig more!

--- Mystic BBS v1.12 A45 2020/02/13 (Windows/64)
* Origin: Sector 7 (21:1/108)

I'll take a look at the templates you put out couple days ago.

I may be good to retain my throttling by reverse proxying the flows thru NGINX.

Just FYI adding throttling is something on my TODO list, and something I very much want to personally see added so I hope to do it sometime soon.

You'd also gain other benefits from a reverse proxy (besides the obvious network security benefits) in that you'd gain TLS and HTTP 1.1 too!

--- Mystic BBS v1.12 A45 2020/02/14 (Windows/64)
* Origin: Sector 7 (21:1/108)

I'll take a look at the templates you put out couple days ago.

I may be good to retain my throttling by reverse proxying the flows t NGINX.

Just FYI adding throttling is something on my TODO list, and something I very much want to personally see added so I hope to do it sometime soon.

That would be really cool. For the same reason I use external protocols so I can wrap them with trickle. If throttling could be done on the internal protocols, that would save a step there as well...

You'd also gain other benefits from a reverse proxy (besides the obvious network security benefits) in that you'd gain TLS and HTTP 1.1 too!

Yeah, I always reverse proxy and do the SSL in-front so my IPS sees what is happening...

Cheers!

|15 ▀ ▐ |15StackFault |08<|03.|11.|15P|11h|03EN|11o|15M|11.|03.|08>
|11 ▌ ▀ |11The Bottomless Abyss BBS
|03 ▀ ▌▀ |03ssh|08.|072222 |08/ |03telnet|08.|072023 |08/ |03https
|08 ▄■▐ |08bbs|07.|08bottomlessabyss|07.|08net

--- Mystic BBS v1.12 A43 2019/03/02 (Linux/64)
* Origin: The Bottomless Abyss BBS * bbs.bottomlessabyss.net (21:1/172)

On 14 Feb 2020, Beery said the following...

I just tried the Http process to download files. I dropped those zip files into the folder as you mentioned earlier. I think I see the issue, but do not know the solution.

My URL to the files had the port address for telnetting into my BBS, well as the http address:

Something like http://9640news.ddns.net:9640:8080/directoryname

You must have the port entered in Servers > General Options > Domain
Name. Take that out, it should give you a proper URL.

Yep, that was the issue. Thanks.

Wish my issue were that easy to figure out. =)

--- Mystic BBS v1.12 A45 2020/02/12 (Linux/64)
* Origin: throwbackbbs.com -\- meriden, ct -\- (21:1/114)

--Beery Miller -- 9640 News BBS -- 9640news.ddns.net:9640 --

--- Mystic BBS v1.12 A44 2020/02/04 (Windows/64)
* Origin: 9640 News BBS (21:4/109)

What do you have set for your "BBS Domain" in your server general settings? My guess is that you may have your port included in that. It should only be the Domain name and if you include the port there it will end up breaking a bunch of things (Email, FTP server passive functions, HTTP downloads, and so on).

That was it.

Thanks

Beery

--Beery Miller -- 9640 News BBS -- 9640news.ddns.net:9640 --

--- Mystic BBS v1.12 A44 2020/02/04 (Windows/64)
* Origin: 9640 News BBS (21:4/109)