Unable to open files from a specific folder from SharePoint Site. It throws 404 file not found message.

I was able to narrow down the issue to specific to a folder where all files throws 404 page cannot be found message. But the files from other folders in the same document library were accessible. In few minutes the plus sign (+) with in the folder name found in my eyes which differ this folder from others. (Example : Folder + name). I created a new folder with plus sign (+) in between the folder name and reproduced the issue. 

Using the following characters anywhere in a site name, in a subsite name, or in a site or Active Directory group names are not supported:

Tilde (~)
Number sign (#)
Percent (%)
Ampersand (&)
Asterisk (*)
Braces ({ })
Backslash (\)
Colon (:)
Angle brackets (< >)
Question mark (?)
Slash (/)
Plus sign (+)
Pipe (|)
Quotation mark (")

Ref: https://support.microsoft.com/en-us/kb/905231