Skip to main content

AWS CloudFront base64 file upload randomly got 502 Bad Gateway error

I have build a upload function for my customer. Due to SQL injection prevent, some of my customer images got blocked by CloudFront. But instead of trying to manually clean these injection, customer want normal upload. (I can use some tool like imagemagick to convert back and ford png/jpg for example to clean injection part).
So I ended up by using base64 encoding and custom jQuery fileupload (blueimp). This lead to some other problems, mostly randomly got 502 error on batch of 200 files upload.

https://stackoverflow.com/questions/20664018/cloudfront-custom-origin-distribution-returns-502-error-the-request-could-not-b

https://www.tessian.com/blog/how-to-fix-http-502-errors/



I had a similar issue recently which turned out to be due to ssl_ciphers that I was using.


From http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/RequestAndResponseBehaviorCustomOrigin.html,


"CloudFront forwards HTTPS requests to the origin server using the SSLv3 or TLSv1 protocols and the AES128-SHA1 or RC4-MD5 ciphers. If your origin server does not support either the AES128-SHA1 or RC4-MD5 ciphers, CloudFront cannot establish an SSL connection to your origin. "


I had to change my nginx confg to add AES128-SHA ( deprecated RC4:HIGH ) to ssl_ciphers to fix the 302 error. I hope this helps. I have pasted the line from my ssl.conf


ssl_ciphers ECDH+AESGCM:ECDH+AES256:ECDH+AES128:DH+3DES:RSA+3DES:AES128-SHA:!ADH:!AECDH:!MD5; 

https://aws.amazon.com/blogs/security/three-most-important-aws-waf-rate-based-rules/

https://blogs.halodoc.io/apply-rate-limiting-to-your-resources-using-aws-cloud-front-and-waf/

https://blogs.halodoc.io/apply-rate-limiting-to-your-resources-using-aws-cloud-front-and-waf/




For my case simple reduce  concurrent uploading files solved issue.
limitConcurrentUploads: 10,


    const maxChunkSize = 5000 * 1000;

    $("#fileupload").fileupload({
        url: 'uploadMediaFile',
        dataType: "json",
        autoUpload: true,
        // maxChunkSize: maxChunkSize,
        dropZone: $('#drag-and-drop-zone'),
        disableImageResize: true,
        // limitConcurrentUploads
        // sequentialUploads: false,
        // singleFileUploads: false,
        // limitMultiFileUploadSizeOverhead,
        limitMultiFileUploads: 10,

        add: function (e, data) {
            var acceptFileTypes = extFilter;
            let file = data.originalFiles[0];
            if (typeof file == 'undefined') {
                console.log('undefined file');
                return;
            }
....
});

Comments

  1. `Indian Hyderabadi cuisine is famous all over the world. Everyone loves Hyderabadi Indian cuisine. Adeena's Kitchen is the first restaurant to provide Hyderabadi Indian food in London to its customers.
    Adeena's kitchen is located in Croydon, London. London regorges of tourist attractions. The restaurant serves the best version of Indian Hyderabadi cuisine to Indian connoisseurs. The irresistible taste, the rich fragrance, the rich blend of epics, and the aroma of traditional Indian spices will remind you of your country, and homeland. The quiet atmosphere of the restaurant will allow you to spend more time with your family or friends. We offer budget lunch and dinner for you to enjoy the scrumptious dishes while saving money. From the main course to Hyderabadi Biryani, to non-veg curries, to mouth-watering tandoori dishes, to Hyderabadi Haleem especially during Ramzan. Only fresh ingredients and spices are used to bring out the authentic Hyderabadi flavour to the dishes. So if you are using an outing with friends, or family members, this is the best place for appetizer aperitifs. The restaurant offers a variety of classic and contemporary dishes.02036678566


    adeenaskitchen.co.uk
    ..We deliver delicious Hyderabadi food to your doorstep.

    ReplyDelete
  2. An Indian Restaurant & Takeaway in Croydon. We serve a wide range of delicious Asian & Indian food. We offer online ordering and table booking.For reservation call 02036678566


    adeenaskitchen.co.uk/

    ReplyDelete

Post a Comment

Popular posts from this blog

Rand mm 10

https://stackoverflow.com/questions/2447791/define-vs-const Oh const vs define, many time I got unexpected interview question. As this one, I do not know much or try to study this. My work flow, and I believe of many programmer is that search topic only when we have task or job to tackle. We ignore many 'basic', 'fundamental' documents, RTFM is boring. So I think it is a trade off between the two way of study language. And I think there are a bridge or balanced way to extract both advantage of two method. There are some huge issue with programmer like me that prevent we master some technique that take only little time if doing properly. For example, some Red Hat certificate program, lesson, course that I have learned during Collage gave our exceptional useful when it cover almost all topic while working with Linux. I remember it called something like RHEL (RedHat Enterprise Linux) Certificate... I think there are many tons of documents, guide n books about Linux bu

Martin Fowler - Software Architecture - Making Architecture matter

  https://martinfowler.com/architecture/ One can appreciate the point of this presentation when one's sense of code smell is trained, functional and utilized. Those controlling the budget as well as developer leads should understand the design stamina hypothesis, so that the appropriate focus and priority is given to internal quality - otherwise pay a high price soon. Andrew Farrell 8 months ago I love that he was able to give an important lesson on the “How?” of software architecture at the very end: delegate decisions to those with the time to focus on them. Very nice and straight-forward talk about the value of software architecture For me, architecture is the distribution of complexity in a system. And also, how subsystems communicate with each other. A battle between craftmanship and the economics and economics always win... https://hackernoon.com/applying-clean-architecture-on-web-application-with-modular-pattern-7b11f1b89011 1. Independent of Frameworks 2. Testable 3. Indepe