OK, got the answer myself.
I am used to use Axios library for the requests; There was one configuration property in the request missing, the response type must be "arraybuffer" (not "stream", not "blob").
So, the request properties are then something like that:
{
headers: {
'Authorization': `Bearer ....`,
'content-type': 'image/jpeg'
},
responseType: 'arraybuffer'
});
After enconding that as base64 string, the decoding back to .jpeg also works fine!