Wing FTP Software

The official forum of Wing FTP Software
https://bbs.wftpserver.com/

CSV file gets corrupted when being uploaded

https://bbs.wftpserver.com/viewtopic.php?t=3282

Page 1 of 1

CSV file gets corrupted when being uploaded

Posted: Tue Jan 17, 2017 1:33 pm
by WouterVH
Hello,

I work for an IT company who has set up WingFTP for one of it's customers in the past. Recently, an issue started occuring where some csv files are getting corrupted when they are uploaded to the WingFTP server.
This only happens occasionally, e.g. you can upload the file to a folder on the FTP server and have it open correctly, but if you upload the same file 10 minutes later to the same folder, it's possible that it won't open this time.
With corrupted, I mean that the majority of the file contains nothing (null values if you open it in a hex editor), yet the file size is still the same as the original file.
I have already tried several things (creating a new folder, creating a new user, checked the firewall, checked ntfs permissions as the fileserver to which the FTP server points is a Windows machine, uploaded the file via the webinterface as well as via an FTP client like FileZilla,..) but the same problem keeps occurring randomly.

The problematic files are larger than the average file being uploaded (143 MB), but no quota's have been set and as it sometimes does work, I don't think the size is the issue.
A new FTP server has recently been set up (WingFTP 4.8.2, the previous one was 4.6.2), but we keep having the same issue with this one.

Does anybody have any idea what else could be causing this? Is there something that I'm missing?

Kind regards,

Wouter

Re: CSV file gets corrupted when being uploaded

Posted: Thu Jan 19, 2017 5:38 am
by FTP
Which transfer protocol are you using? And could you provide the related server logs?

Re: CSV file gets corrupted when being uploaded

Posted: Thu Jan 19, 2017 8:15 am
by WouterVH
I have tried with FTP, FTPS and SFTP. All of these protocols result in the same behaviour.
The logs below are all from transfers that resulted in a corrupted file. So far I haven't been able to produce a working transfer anymore, I will try a couple more times today and upload the log if a transfer succeeds.

FTP log:

Code: Select all

[02] Thu, 19 Jan 2017 08:23:32 (0030257) Connected from <client IP> (local address <server IP>, port 21)
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 220 Wing FTP Server ready...
[03] Thu, 19 Jan 2017 08:23:32 (0030257) AUTH TLS
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 234 AUTH command OK. Initializing TLS connection.
[03] Thu, 19 Jan 2017 08:23:32 (0030257) USER <UserName>
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 331 Password required for <UserName>
[03] Thu, 19 Jan 2017 08:23:32 (0030257) PASS **********
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 230 User <UserName> logged in.
[03] Thu, 19 Jan 2017 08:23:32 (0030257) CLNT FileZilla
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 200 Noted.
[03] Thu, 19 Jan 2017 08:23:32 (0030257) OPTS UTF8 ON
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 200 OPTS UTF8 ON
[03] Thu, 19 Jan 2017 08:23:32 (0030257) PBSZ 0
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 200 Command okay. PBSZ=0.
[03] Thu, 19 Jan 2017 08:23:32 (0030257) PROT P
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 200 Encrypting Data Channel.
[03] Thu, 19 Jan 2017 08:23:32 (0030257) CWD <DestinationFolder>
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 250 CWD command successful. "<DestinationFolder>" is current directory.
[03] Thu, 19 Jan 2017 08:23:32 (0030257) PWD
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 257 "<DestinationFolder>" is current directory.
[03] Thu, 19 Jan 2017 08:23:32 (0030257) TYPE I
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 200 Type set to I
[03] Thu, 19 Jan 2017 08:23:32 (0030257) PASV
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 227 Entering Passive Mode (<public IP>,8,90)
[03] Thu, 19 Jan 2017 08:23:32 (0030257) STOR <FILENAME>.csv
[04] Thu, 19 Jan 2017 08:23:32 (0030257) 150 Opening BINARY mode data connection for file transfer.

[04] Thu, 19 Jan 2017 08:24:58 (0030257) 226 File received ok.Transfer bytes:150453305Bytes;Average speed is:1688.817KB/s
[03] Thu, 19 Jan 2017 08:24:58 (0030257) PASV
[04] Thu, 19 Jan 2017 08:24:58 (0030257) 227 Entering Passive Mode (<public IP>,8,91)
[03] Thu, 19 Jan 2017 08:24:58 (0030257) MLSD
[04] Thu, 19 Jan 2017 08:24:58 (0030257) 150 Opening data channel for directory list.
[04] Thu, 19 Jan 2017 08:24:58 (0030257) 226 Transfer ok.
FTPS log:

Code: Select all

[02] Thu, 19 Jan 2017 09:03:12 (0030366) Connected from <client IP> (local address <server IP>, port 990)
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 220 Wing FTP Server ready...
[03] Thu, 19 Jan 2017 09:03:12 (0030366) USER <UserName>
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 331 Password required for <UserName>
[03] Thu, 19 Jan 2017 09:03:12 (0030366) PASS **********
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 230 User <UserName> logged in.
[03] Thu, 19 Jan 2017 09:03:12 (0030366) CLNT FileZilla
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 200 Noted.
[03] Thu, 19 Jan 2017 09:03:12 (0030366) OPTS UTF8 ON
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 200 OPTS UTF8 ON
[03] Thu, 19 Jan 2017 09:03:12 (0030366) PBSZ 0
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 200 Command okay. PBSZ=0.
[03] Thu, 19 Jan 2017 09:03:12 (0030366) PROT P
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 200 Encrypting Data Channel.
[03] Thu, 19 Jan 2017 09:03:12 (0030366) CWD <DestinationFolder>
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 250 CWD command successful. "<DestinationFolder>" is current directory.
[03] Thu, 19 Jan 2017 09:03:12 (0030366) TYPE I
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 200 Type set to I
[03] Thu, 19 Jan 2017 09:03:12 (0030366) PASV
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 227 Entering Passive Mode (<public IP>,8,99)
[03] Thu, 19 Jan 2017 09:03:12 (0030366) STOR <FILENAME>.csv
[04] Thu, 19 Jan 2017 09:03:12 (0030366) 150 Opening BINARY mode data connection for file transfer.
[05] Thu, 19 Jan 2017 09:07:19 (0030237) Keep alive
[02] Thu, 19 Jan 2017 09:08:09 (0030365) Closed session,disconnected from <client IP>
[04] Thu, 19 Jan 2017 09:08:28 (0030366) 226 File received ok.Transfer bytes:150453305Bytes;Average speed is:463.492KB/s
[03] Thu, 19 Jan 2017 09:08:28 (0030366) PASV
[04] Thu, 19 Jan 2017 09:08:28 (0030366) 227 Entering Passive Mode (<public IP>,8,100)
[03] Thu, 19 Jan 2017 09:08:28 (0030366) MLSD
[04] Thu, 19 Jan 2017 09:08:29 (0030366) 150 Opening data channel for directory list.
[04] Thu, 19 Jan 2017 09:08:29 (0030366) 226 Transfer ok.
SFTP log:

Code: Select all

[02] Thu, 19 Jan 2017 08:36:46 (0030292) Connected from <client IP> (local address <server IP>, port 22)
[01] Thu, 19 Jan 2017 08:36:46 (0030292) User/password authentication OK.
[01] Thu, 19 Jan 2017 08:36:46 (0030292) SSH authentication completed successfully. Client information: SSH-2.0-PuTTY_Local:_Mar_29_2015_12:25:15
[01] Thu, 19 Jan 2017 08:36:46 (0030292) The user <UserName> logged in successfully via SSH.
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_INIT: client SSH version 3
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_VERSION: server SSH version 3
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_REALPATH: path .
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_NAME: path .
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_REALPATH: path <DestinationFolder>
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_NAME: path <DestinationFolder>
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_OPENDIR: directory <DestinationFolder>
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_HANDLE: path <DestinationFolder>
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_CLOSE: path <DestinationFolder>
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_STATUS: <DestinationFolder> has been closed.
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_REALPATH: path <DestinationFolder>/<FILENAME>.csv
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_STATUS: "<DestinationFolder>/<FILENAME>.csv": No such file.
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_REALPATH: path <DestinationFolder>
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_NAME: path <DestinationFolder>
[07] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_OPEN: path <DestinationFolder>/<FILENAME>.csv
[07] Thu, 19 Jan 2017 08:36:46 (0030292) Transfer starting for <DestinationFolder>/<FILENAME>.csv
[08] Thu, 19 Jan 2017 08:36:46 (0030292) SSH_FXP_HANDLE: <DestinationFolder>/<FILENAME>.csv has been opened.
[05] Thu, 19 Jan 2017 08:37:19 (0030237) Keep alive
[07] Thu, 19 Jan 2017 08:37:21 (0030292) SSH_FXP_CLOSE: path <DestinationFolder>/<FILENAME>.csv
[07] Thu, 19 Jan 2017 08:37:21 (0030292) File received successful, transferred 150453305 Bytes in 35 seconds, 4197.9 KB/S
[08] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_STATUS: <DestinationFolder>/<FILENAME>.csv has been closed.
[07] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_REALPATH: path <DestinationFolder>/.
[08] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_NAME: path <DestinationFolder>/.
[07] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_OPENDIR: directory <DestinationFolder>
[08] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_HANDLE: path <DestinationFolder>
[07] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_READDIR: directory <DestinationFolder>
[08] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_NAME: 7 items have been found
[07] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_READDIR: directory <DestinationFolder>
[08] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_STATUS: End of file
[07] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_CLOSE: path <DestinationFolder>
[08] Thu, 19 Jan 2017 08:37:22 (0030292) SSH_FXP_STATUS: <DestinationFolder> has been closed.

Re: CSV file gets corrupted when being uploaded

Posted: Fri Jan 20, 2017 3:25 am
by FTP
From the server logs, the transfer was successful and transferred the whole file (150453305 Bytes).
I think this issue was caused by the client side, maybe you can test it with another computer (had better not in the same LAN).

Re: CSV file gets corrupted when being uploaded

Posted: Fri Jan 20, 2017 11:03 am
by WouterVH
It looks indeed as if the file was transferred correctly. The source and destination files even have the same size.
I have tried from 2 different computers within the same LAN and 1 computer from an external network. We keep getting the same issue on all of them.
All times are UTC
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited