webservices uploading a 50mb file

Is there a setting I need to change when uploading a large file?

When the file reaches 50mb, webservices uploaddocument function throws an exception 404 not found

Raymond,

According to the documentation found here:

https://developer.docuware.com/sdk/platform-eagle/html/57da87ed-111c-4f78-96e9-75d3b9462ce9.htm

and

https://developer.docuware.com/sdk/platform-eagle/html/c3431d10-b73e-4b98-814a-a0d235d21f80.htm

there are two different upload methods you can use, and one is meant for larger files.

Here is C# code I use to upload files, and I set the threshold at 10 MB:

 

        public static Document UploadFileToFileCabinet(FileCabinet fileCabinet, string uploadFile, Document indexInfo = null)
        {
            LastError = "";
            try
            {
                // We will use a standard upload method for smaller files, but the "Easy" version for larger files, otherwise
                // large file uploads might fail (the "Easy" version is meant for huge file uploads, according to the documentation).
                int largeFileThresholdInBytes = 10 * 1024 * 1024;    // 10 MB
                Document uploadedDoc = null;
                FileInfo fileInfo = new FileInfo(uploadFile);
                if (fileInfo.Length < largeFileThresholdInBytes)
                {
                    // Smaller file.
                    uploadedDoc = fileCabinet.UploadDocument(indexInfo, fileInfo);
                }
                else
                {
                    // Larger file.
                    uploadedDoc = fileCabinet.EasyUploadSingleDocument(fileInfo, indexInfo);
                }
                return uploadedDoc;
            }
            catch (Exception ex)
            {
                LastError = ex.Message;
                return null;
            }
        }

The "Easy" method is part of some extensions, though, so I am not sure it has a direct resource end-point when doing API calls via non-NET environments.

Are you using .NET to access the API? If not, what are you using? I see in my non-NET code (Visual FoxPro) that if I need to upload a large file I shell out to the .NET program I wrote to upload files instead of using the straight HTTP endpoint to upload. So, I must have run into the same issue you are facing. The only truly reliable way to upload huge files is with the .NET code. With that code I have uploaded files greater than 1 GB in size.

Thanks,
Joe Kaufman


 

I found an upload with chunks function, but wasn't sure what the setting for the chunk size, kb or mb. or just b.

I also found:
https://support.docuware.com/en-us/knowledgebase/article/KBA-35482 but the setting mentioned isn't in the web.config.

.
will give the EasyUploadSingleDocument a try.

I'm coding in vb.net, but I can convert the code above to vb
 

The easy upload fixed my issue.

I found an IIS setting, #2 in:
https://www.inflectra.com/support/knowledgebase/kb306.aspx

Is there more overhead when using EasyUploadSingleDocument vs UploadDocument

Raymond,

I don't know about overhead, all I ever did was time the uploads. The "Easy" method is a bit slower (but not much, as I recall), which is why I made a threshold to not use it unless a document was over a certain size.

If there is overhead, I imagine it would only be on the client, since that is where the file is being split out and sent in smaller chunks. Though, I suppose the server has to use a few more resources to wait for the chunks and put the file together again before saving. My knowledge of HTTP and IIS is woefully in adequate to determine whether or not there is a perceptible difference.

Glad it worked for you, in any case, since even if it does take more resources it has to be done to get these large files uploaded!

Thanks,
Joe Kaufman

I have had informations about a 30 Mb limit with DocuWare Cloud. So if you want to upload larger file you need to do a chunked upload.
The process to send chunks to DocuWare was quite difficult to understand.
You need to use differents headers for your request (see code below). After each chunk sent the XML DocuWare response contains a  link to send the next chunk.
Python example :

def read_in_chunks(file_object, chunk_size=3000000):
    while True:
        data = file_object.read(chunk_size)
        if not data:
            break
        yield data

def UploadBigFile(file, queryurl, session, url):
 
    content_name, file_extension = os.path.splitext(file)
    content_path = os.path.abspath(file)
    content_size = os.stat(content_path).st_size
    print('Fichier transféré : '+content_name+file_extension)
    print('Taille du fichier : '+str(content_size))
    mtime=os.path.getmtime(file)
 
    f = open(content_path,'rb')
 
    index = 0
    offset = 0
    headers = {}
 
    for chunk in read_in_chunks(f):
        offset = index + len(chunk)
        headers['X-File-Name'] = content_name+'.'+file_extension
        headers['X-File-Type'] = 'application/'+file_extension
        headers['X-File-Size'] = str(content_size)
        headers['X-File-ModifiedDate'] = time.strftime('"%Y-%m-%dT%H:%M:%SZ"', time.gmtime(mtime))
        ContentRange = 'octets %s-%s/%s' % (str(index), str(offset), str(content_size))
        index = offset
        r = session.request("POST",queryurl, data=chunk, headers=headers)
        print("r: %s, Interval de données: %s" % (r, ContentRange))
        file=open("chunk_response.xml","w+")
        file.write(r.content.decode())
        file.close()
        chunktree = ET.parse("response.xml",ET.XMLParser(encoding='ISO-8859-1'))
        chunkroot = chunktree.getroot()
        for member in chunkroot.findall('ns:FileChunk/s:Links/s:Link',namespaces):
            queryurl=url+ member.get('href')
            print(queryurl)
 
    print(r.text)
    return r