B4J Tutorial Building a mini "Email based server"

This example uses jNet library together with the MailParser module to build a program that responds to emails.

SS-2013-11-27_10.48.58.png


Although it sounds a bit strange, using emails as the communication channel can be very simple and useful.

You do not need to worry about hosting, firewall or (partially) downtime issues. Let Google, Yahoo, Microsoft or one of the other email providers solve these issues for you.

This program checks an email account every two minutes. If it finds a message it downloads it, parses it and deletes it.

In this case the "server" doesn't do anything useful. It checks the subject line. If the value is 13 then it sends a reply with the current time.

A client (B4A) program can use SMTP from the Net library to send emails to this server.

You can for example send database updates as an attachment and insert the data to a database. Or any other creative solution you can think of...
 

Attachments

  • EmailServer.zip
    3.5 KB · Views: 2,077
Click to expand...
C

Christos Dorotheou

Member
Licensed User
Longtime User
manios said:
Hi Christos,
Thanks for the Sub. It helps and works OK.
However something is still wrong with the coding of the mails or the decoding. I get intermittend some "=" and "=20" characters/strings in the message body from the Mailparser. This finally screws up the conversion and contents.
I will try to get the raw contents of the mail with an old VB program and see what is wrong
Click to expand...

You can store the Raw mail contents, from within the ParseMultipartBody() routine by saving it in a folder of your choice and a file name
with a .txt extension and then you can open it with any text editor and inspect it.

You can even give it an .eml extension and this way is saved as an email which can be opened by many email clients such as Outlook Express.

This is also one way to backup locally your received emails.

Please see bellow:

B4X: 
Sub ParseMultipartBody (Mail As String, Msg As Message)
    'find first boundary
    index = Mail.IndexOf2("--" & boundary, index)
    ReadNextLine(Mail)
    Dim headers As StringBuilder
    headers.Initialize
    Do While index < Mail.Length
        Dim line As String
        line = ReadNextLine(Mail)
        If line.Length > 0 Then
            headers.Append(line).Append(" ")
        Else If index < Mail.Length Then
            Dim nextPart As Int
            nextPart = Mail.IndexOf2("--" & boundary, index)
            If nextPart-4 > index Then
                HandlePart(headers.ToString, Mail.SubString2(index, nextPart-4), Msg)
            End If
            If nextPart = -1 Then Return
            index = nextPart
            ReadNextLine(Mail)
            headers.Initialize
        End If
    Loop
   
    File.WriteString("C:\Temp", "AnyName.eml", Mail)
    File.WriteString("C:\Temp", "AnyName.txt", Mail)
   
End Sub
 
M

manios

Active Member
Licensed User
Longtime User
Checking the raw contents of the messages, I finally found out that the message body does contain incorrect characters. However displaying the .eml file with an email-client these characters are not shown. The mails are generated from a form on a TYPO3 website, need to go back to the originator. Its very strange!
Manios
 
C

Christos Dorotheou

Member
Licensed User
Longtime User
manios said:
Hi Christos,
Thanks for the Sub. It helps and works OK.
However something is still wrong with the coding of the mails or the decoding. I get intermittend some "=" and "=20" characters/strings in the message body from the Mailparser. This finally screws up the conversion and contents.
I will try to get the raw contents of the mail with an old VB program and see what is wrong
Click to expand...

Manios,

Please bare in mind that UTF2UNI() routine works flawsely for encoded sentences with UTF-8 Character Set for the time being, but probably will return some strange results back if the character set being used to encode the text is ISO-8859-x.
I am working on a more robust Routine which will handle the encoded sentences based on the Character Set used.

As far as the "=" and "=20" is concerned characters you have mentioned, these have a special purpose defined in RFC 822.
Generally when there is a multi-line encoded text, each line must be terminated with "=" to help parsers, and as far "=20" is concerned this is a SPACE Character.

Ok this is the upgraded UTF2UNI() routine which will decode the encoded text passed to the routine, based on the Character Set used.

B4X: 
Sub UTF2UNI(s2match As String, CharSet As String) As String
Dim m As Matcher
Dim Parts As List
Dim cnv As ByteConverter
Dim i, j As Int
Dim i2s As String
Dim SupportedEncodings() As String
Dim booCharSetIsValid As Boolean

Parts.Initialize
SupportedEncodings = cnv.SupportedEncodings

booCharSetIsValid = False
For j = 0 To SupportedEncodings.Length - 1
    If CharSet.ToUpperCase = SupportedEncodings(j).ToUpperCase Then
      booCharSetIsValid = True
    End If       
Next

If booCharSetIsValid = True Then
  If CharSet.Trim.ToLowerCase = "utf-8" Then
      m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]=[0-9a-fA-F][0-9a-fA-F]",s2match)

      i = -1
      Do While m.Find = True
        i = i + 1
        i2s = i
     
        Do While i2s.Trim.Length < 2
            i2s = "0" & i2s
        Loop   
     
        Parts.Add(m.Group(0).Replace("=",""))
        s2match = s2match.Replace(m.Group(0),"~" & i2s)
        m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]=[0-9a-fA-F][0-9a-fA-F]",s2match)
      Loop

      If Parts.Size > 0 Then
        For i = 0 To Parts.Size - 1
            i2s = i
            Do While i2s.Trim.Length < 2
                i2s = "0" & i2s
            Loop
            s2match = s2match.Replace("~" & i2s, cnv.StringFromBytes(cnv.HexToBytes(Parts.Get(i)), CharSet))
        Next
      End If
  Else
      s2match = s2match.Trim
      s2match = s2match.Replace(" ","=20")
 
      If s2match.EndsWith("=") = True Then
        s2match = s2match.SubString2(0,s2match.Length-1)
      End If     
 
      m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]",s2match)

      i = -1
      Do While m.Find = True
        i = i + 1
        i2s = i
        Do While i2s.Trim.Length < 2
            i2s = "0" & i2s
        Loop
     
        Parts.Add(m.Group(0).Replace("=",""))
        s2match = s2match.Replace(m.Group(0),"~" & i2s)
     
        m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]",s2match)
      Loop

      If Parts.Size > 0 Then
        For i = 0 To Parts.Size - 1
            i2s = i
            Do While i2s.Trim.Length < 2
                i2s = "0" & i2s
            Loop         
            s2match = s2match.Replace("~" & i2s, cnv.StringFromBytes(cnv.HexToBytes(Parts.Get(i)), CharSet))
        Next
      End If 
  End If
End If

Return s2match

End Sub
 
Last edited:
C

Christos Dorotheou

Member
Licensed User
Longtime User
Christos Dorotheou said:
Manios,

Please bare in mind that UTF2UNI() routine works flawsely for encoded sentences with UTF-8 Character Set for the time being, but probably will return some strange results back if the character set being used to encode the text is ISO-8859-x.
I am working on a more robust Routine which will handle the encoded sentences based on the Character Set used.

As far as the "=" and "=20" is concerned characters you have mentioned, these have a special purpose defined in RFC 822.
Generally when there is a multi-line encoded text, each line must be terminated with "=" to help parsers, and as far "=20" is concerned this is a SPACE Character.

Ok this is the upgraded UTF2UNI() routine which will decode the encoded text passed to the routine, based on the Character Set used.

B4X: 
Sub UTF2UNI(s2match As String, CharSet As String) As String
Dim m As Matcher
Dim Parts As List
Dim cnv As ByteConverter
Dim i, j As Int
Dim i2s As String
Dim SupportedEncodings() As String
Dim booCharSetIsValid As Boolean

Parts.Initialize
SupportedEncodings = cnv.SupportedEncodings

booCharSetIsValid = False
For j = 0 To SupportedEncodings.Length - 1
    If CharSet.ToUpperCase = SupportedEncodings(j).ToUpperCase Then
      booCharSetIsValid = True
    End If      
Next

If booCharSetIsValid = True Then
  If CharSet.Trim.ToLowerCase = "utf-8" Then
      m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]=[0-9a-fA-F][0-9a-fA-F]",s2match)

      i = -1
      Do While m.Find = True
        i = i + 1
        i2s = i
    
        Do While i2s.Trim.Length < 2
            i2s = "0" & i2s
        Loop  
    
        Parts.Add(m.Group(0).Replace("=",""))
        s2match = s2match.Replace(m.Group(0),"~" & i2s)
        m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]=[0-9a-fA-F][0-9a-fA-F]",s2match)
      Loop

      If Parts.Size > 0 Then
        For i = 0 To Parts.Size - 1
            i2s = i
            Do While i2s.Trim.Length < 2
                i2s = "0" & i2s
            Loop
            s2match = s2match.Replace("~" & i2s, cnv.StringFromBytes(cnv.HexToBytes(Parts.Get(i)), CharSet))
        Next
      End If
  Else
      s2match = s2match.Trim
      s2match = s2match.Replace(" ","=20")

      If s2match.EndsWith("=") = True Then
        s2match = s2match.SubString2(0,s2match.Length-1)
      End If    

      m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]",s2match)

      i = -1
      Do While m.Find = True
        i = i + 1
        i2s = i
        Do While i2s.Trim.Length < 2
            i2s = "0" & i2s
        Loop
    
        Parts.Add(m.Group(0).Replace("=",""))
        s2match = s2match.Replace(m.Group(0),"~" & i2s)
    
        m = Regex.Matcher("=[0-9a-fA-F][0-9a-fA-F]",s2match)
      Loop

      If Parts.Size > 0 Then
        For i = 0 To Parts.Size - 1
            i2s = i
            Do While i2s.Trim.Length < 2
                i2s = "0" & i2s
            Loop        
            s2match = s2match.Replace("~" & i2s, cnv.StringFromBytes(cnv.HexToBytes(Parts.Get(i)), CharSet))
        Next
      End If
  End If
End If

Return s2match

End Sub
Click to expand...


Since I have now, got a better understanding of B4J and MIME inner workings, I've rewritten the UTF2UNI() routine
to be more compact and simplified. Sorry if I've got carried away.

Here is the compact version of it:

B4X: 
Sub UnMIME(s2match As String, CharSet As String) As String
Dim m As Matcher
Dim cnv As ByteConverter
Dim SupportedEncodings() As String
Dim booCharSetIsValid As Boolean
Dim c2match As String
Dim j As Int

SupportedEncodings = cnv.SupportedEncodings

booCharSetIsValid = False
For j = 0 To SupportedEncodings.Length - 1
    If CharSet.ToUpperCase = SupportedEncodings(j).ToUpperCase Then
      booCharSetIsValid = True
    End If       
Next

If booCharSetIsValid = True Then
  If CharSet.Trim.ToLowerCase = "utf-8" Then
      c2match = "=[0-9a-fA-F][0-9a-fA-F]=[0-9a-fA-F][0-9a-fA-F]"
  Else
      c2match = "=[0-9a-fA-F][0-9a-fA-F]"
      s2match = s2match.Trim
      s2match = s2match.Replace(" ","=20")
      If s2match.EndsWith("=") = True Then
        s2match = s2match.SubString2(0,s2match.Length-1)
      End If     
  End If 
  m = Regex.Matcher(c2match,s2match)
  Do While m.Find = True
      s2match = s2match.Replace(m.Group(0), cnv.StringFromBytes(cnv.HexToBytes(m.Group(0).Replace("=","")), CharSet))
      m = Regex.Matcher(c2match,s2match)
  Loop
End If

Return s2match

End Sub
 
incendio

incendio

Well-Known Member
Licensed User
Longtime User
I have an app to send email that based on this example.

My app has an email distribution list, store in sql database.

Codes something like this :
B4X: 
Cursor = Sql.ExecQuery("select * from table where tag = 'N' )
Do While Cursor.NextRow
  Id = Cursor.GetInt("ID") 
  To = Cursor.GetString("TO")
  Subject = Cursor.GetString("SUBJECT")
  Body = Cursor.GetString("BODY")
  SMTP.To.Add(To)
  SMTP.Subject = Subject
  SMTP.Body    = Body
  SMTP.Send
Loop
Cursor.Close

Since Cursor can return more than 1 row, should I paused a few second for each rows after email sent or the code above is ok?
 
Beja

Beja

Expert
Licensed User
Longtime User
Yep!
That's it.. thanks Erel.
I also got email from Google support saying:
Some examples of apps that do not support the latest security standards include:
•The Mail app on your iPhone or iPad with iOS 6 or below
•The Mail app on your Windows phone preceding the 8.1 release
•Some Desktop mail clients like Microsoft Outlook and Mozilla Thunderbird
Click to expand...
does that means Android apps like this one is safe and I can go ahead and set the less-security?
 

Attachments

  • googlemsg.png
    googlemsg.png
    30.8 KB · Views: 394
Beja

Beja

Expert
Licensed User
Longtime User
Now the app is receiving the messages, but...
I am not sure if this already addressed but I get this error message:

03/11/2015 15:29:49: Found messages: 1
03/11/2015 15:29:49: Message from: #### #### <####@####.###>, subject: 13
03/11/2015 15:29:49: Sending response
03/11/2015 15:29:49: Error sending message: (SSLException) javax.net.ssl.SSLException: Unrecognized SSL message, plaintext connection?
 
Beja

Beja

Expert
Licensed User
Longtime User
I owe you one Erel,
that was my mistake.. I was supposed to put the complete email address in the User variable instead of just the user ID. now working like a charm and I love B4J.

Xie Xie
 
Last edited:
C

codie01

Active Member
Licensed User
Longtime User
Hi All, I have tried the example and get an error that "message" is not a type, "is a Library reference missing" I have jnet installed.

Thanks Phil
 
C

codie01

Active Member
Licensed User
Longtime User
Good Day All,

I am trying to use this mini server example in B4J and am getting a type error "Message" in the code at the beginning of the following sub:

B4X: 
Sub HandleMessage(msg As Message)

What Library is missing for this type please, cannot seem to find a reference.

Kind Regards,
Philip
 
DonManfred

DonManfred

Expert
Licensed User
Longtime User
codie01 said:
What Library is missing for this type please, cannot seem to find a reference.
Click to expand...
Message is declared in MailParser.bas

You already got the answer on Monday (the post before your last one).

Why you are asking the same question again?

doublequestion0085.png
 
Last edited:
ilan

ilan

Expert
Licensed User
Longtime User
thank you very much for this example erel, its perfect!

is it possible to set POP3 to read hebrew letters too? (UTF-8)
what i get now is something like this:

Date: Fri, 17 Jun 2016 09, Message from: ServiceMail@milgam.co.il, subject: =?utf-8?B?15DXmdep15XXqCDXqtep15zXlded?=
Click to expand...

and also i would like to know if the message was read or is still in unread status, is this possible?
 
Last edited:
You must log in or register to reply here.

Similar Threads

Mashiane
  • Article
Share My Creation SithasoDaisy: PocketBase - Mini CRM WebApp Source Code @ $5.00
2 3
Replies
48
Views
7K
Mashiane
Mashiane
aeric
  • Article
Share My Creation [Project Template] Web API Server 2
2 3 4
Replies
68
Views
16K
PABLO2013
PABLO2013
aeric
  • Article
Share My Creation [Project Template] Web API Server
4 5 6
Replies
111
Views
35K
PABLO2013
PABLO2013
alwaysbusy
  • Article
B4J Tutorial [ABMaterial/ABMServer] Mini Template for absolute beginners (update 2024/05/17)
2 3
Replies
46
Views
22K
alwaysbusy
alwaysbusy
Erel
  • Locked
  • Article
B4J Tutorial [Server] Building web servers with B4J
2 3 4
Replies
75
Views
94K
Erel
Erel
Top