View Issue Details

IDProjectCategoryView StatusLast Update
0004117SOGoWeb Mailpublic2017-04-06 15:05
Reporternenonano Assigned Toludovic  
PriorityhighSeverityminorReproducibilityalways
Status resolvedResolutionno change required 
Platform[Server] LinuxOSRHEL/CentOSOS Version6
Product Version3.2.8 
Summary0004117: Message are sent corrupted with one or more recipient(s) in Bcc
Description

Hi there

sogo-3.2.8.20170325-1.centos6.x86_64

sending a message (with or without any attachment) to a recipient in To: field and one in Bcc: one will result in corrupted email

a simple test email is received like this (this is what all my email clients show):

------=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11------
Content-Type: text/plain; charset=utf-8
Content-Length: 17
Content-Transfer-Encoding: 7bit

test 2 messaggio

------=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11------
Content-Type: text/html; charset=utf-8
Content-Length: 29
Content-Transfer-Encoding: 7bit

<html>test 2 messaggio</html>

------=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11--------

Steps To Reproduce

create a new message

add a recipient in To:
add a recipient in Bcc:

TagsNo tags attached.

Activities

nenonano

nenonano

2017-03-29 11:29

reporter  

Senzanome.png (50,512 bytes)   
Senzanome.png (50,512 bytes)   
ludovic

ludovic

2017-03-29 12:53

administrator   ~0011612

Works for me.

nenonano

nenonano

2017-03-29 15:01

reporter   ~0011624

well, glad to know :-)

BTW, it doesn't help me much..

tried with different clients (windows, linux) and different browsers (firefox and chrome) from lan and from wan, with the same result

supposing it is an issue on my side, I'd like to know how to debug it.. I need to debug both client (see 0004098) and server side..

thank you

ludovic

ludovic

2017-03-29 15:02

administrator   ~0011625

Attach the raw source of the email when that happens.

nenonano

nenonano

2017-03-29 15:17

reporter  

email_source.txt (2,038 bytes)   
Delivered-To: Bcc_recipient@gmail.com
Received: by 10.79.35.208 with SMTP id j77csp553556ivj;
        Wed, 29 Mar 2017 04:22:14 -0700 (PDT)
X-Received: by 10.223.145.68 with SMTP id j62mr30220218wrj.44.1490786534200;
        Wed, 29 Mar 2017 04:22:14 -0700 (PDT)
Return-Path: <admin@senderdomain.tld>
Received: from senderdomain.tld (mail.senderdomain.tld. [XX.YY.TT.ZZ])
        by mx.google.com with SMTP id o18si8111052wrc.152.2017.03.29.04.22.13
        for <Bcc_recipient@gmail.com>;
        Wed, 29 Mar 2017 04:22:14 -0700 (PDT)
Received-SPF: pass (google.com: best guess record for domain of admin@senderdomain.tld designates XX.YY.TT.ZZ as permitted sender) client-ip=XX.YY.TT.ZZ;
Authentication-Results: mx.google.com;
       spf=pass (google.com: best guess record for domain of admin@senderdomain.tld designates XX.YY.TT.ZZ as permitted sender) smtp.mailfrom=admin@senderdomain.tld
Received: (qmail 27833 invoked by uid 453); 29 Mar 2017 11:22:13 -0000
X-Virus-Checked: by ClamAV 0.99.2 on senderdomain.tld
X-Virus-Found: No
Authentication-Results: senderdomain.tld; auth=none
Received: from localhost (HELO localhost) (127.0.0.1)
 by senderdomain.tld (qpsmtpd/0.96) with ESMTP ; Wed, 29 Mar 2017 13:22:13 +0200
X-Forward: 89.96.214.206
MIME-Version: 1.0Content-Type: multipart/alternative; boundary="----=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11------"
User-Agent: SOGoMail 3.2.8
From: "Local Administrator" <admin@senderdomain.tld>
To: To_recipient@otherdomain.it
Subject: test
Message-ID: <676a-58db9900-1d-54f53600@90531884>
Date: Wed, 29 Mar 2017 13:22:13 +0200

------=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11------
Content-Type: text/plain; charset=utf-8
Content-Length: 17
Content-Transfer-Encoding: 7bit


test 2 messaggio

------=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11------
Content-Type: text/html; charset=utf-8
Content-Length: 29
Content-Transfer-Encoding: 7bit

<html>test 2 messaggio</html>

------=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11--------


email_source.txt (2,038 bytes)   
nenonano

nenonano

2017-03-29 15:18

reporter   ~0011626

attached email source.. I masked ips and domains..

looking at it it seems that this single line is wrong:

MIME-Version: 1.0Content-Type: multipart/alternative; boundary="----=_=-_OpenGroupware_org_NGMime-26474-1490786533.034377-11------"

ludovic

ludovic

2017-03-29 16:47

administrator   ~0011627

Get the rawsource from your IMAP server (on the filesystem), gzip it and attach it to this ticket.

nenonano

nenonano

2017-03-29 17:19

reporter  

mail.tgz (549 bytes)
nenonano

nenonano

2017-03-30 08:51

reporter   ~0011630

did it and attached

nenonano

nenonano

2017-03-30 14:57

reporter   ~0011631

N.B. the message I attached is the one stored in sent mail of sender account

nenonano

nenonano

2017-03-30 15:06

reporter  

mail1.tgz (1,106 bytes)
nenonano

nenonano

2017-03-30 15:06

reporter   ~0011632

attached the email stored in recipient maildir (no editing at all)

ludovic

ludovic

2017-03-30 15:17

administrator   ~0011633

I've tested the attached mail and works for me.

Lines are terminated by \n instead of \r\n so I have to do a:

perl -pi -e 's/\n/\r\n/' THEFILENAME

on it before injecting it but the BCC code deals only with \r\n terminated code.

How are you sending mails from SOGo? Using the sendmail command or SMTP?

nenonano

nenonano

2017-03-30 22:18

reporter   ~0011637

Smtp

nenonano

nenonano

2017-04-01 11:21

reporter   ~0011650

just create a test machine with latest SOGo and the same O.S. (SME server release 9.1, centos6 derived)

I can confirm that I have the same behaviour
I did these tests:

  • one recipient in To: and Bcc: message get corrupted
  • 2 or more recipients in Bcc: only, no corruption
  • recipients in To:, Cc: and Bcc: message get corrupted

it happens for internal and external recipients
attachments have no influence on this thing

messages are sent via smtp

these are my last updates:

yum.log:Mar 22 22:51:32 Updated: sogo-3.2.7.20170322-1.centos6.x86_64
yum.log:Mar 22 22:51:32 Updated: sogo-tool-3.2.7.20170322-1.centos6.x86_64
yum.log:Mar 22 22:51:32 Updated: sogo-activesync-3.2.7.20170322-1.centos6.x86_64
yum.log:Mar 22 22:51:32 Updated: sogo-ealarms-notify-3.2.7.20170322-1.centos6.x86_64
yum.log:Mar 23 23:08:58 Updated: sogo-3.2.7.20170323-1.centos6.x86_64
yum.log:Mar 23 23:08:58 Updated: sogo-tool-3.2.7.20170323-1.centos6.x86_64
yum.log:Mar 23 23:08:58 Updated: sogo-activesync-3.2.7.20170323-1.centos6.x86_64
yum.log:Mar 23 23:08:58 Updated: sogo-ealarms-notify-3.2.7.20170323-1.centos6.x86_64
yum.log:Mar 25 19:20:41 Updated: sogo-3.2.8.20170325-1.centos6.x86_64
yum.log:Mar 25 19:20:41 Updated: sogo-activesync-3.2.8.20170325-1.centos6.x86_64
yum.log:Mar 25 19:20:41 Updated: sogo-tool-3.2.8.20170325-1.centos6.x86_64
yum.log:Mar 25 19:20:42 Updated: sogo-ealarms-notify-3.2.8.20170325-1.centos6.x86_64
yum.log:Mar 29 18:08:33 Updated: sogo-ealarms-notify-3.2.8.20170328-1.centos6.x86_64
yum.log:Mar 29 18:08:43 Updated: sogo-3.2.8.20170328-1.centos6.x86_64
yum.log:Mar 29 18:08:43 Updated: sogo-tool-3.2.8.20170328-1.centos6.x86_64
yum.log:Mar 29 18:08:43 Updated: sogo-activesync-3.2.8.20170328-1.centos6.x86_64

all the stuff is started from 23rd march

is there any way to try with the old releases?

nenonano

nenonano

2017-04-01 11:30

reporter   ~0011651

I need help to debug this issue, thank you

ludovic

ludovic

2017-04-01 11:32

administrator   ~0011652

Try to install SOGo from source (keep SOPE packages). We can more easily test patches.

http://wiki.sogo.nu/Compilation

nenonano

nenonano

2017-04-01 11:35

reporter   ~0011653

I see it's only for debian.. any hint about compilation on centos/RH6?

nenonano

nenonano

2017-04-01 11:42

reporter   ~0011654

I'd like to rebuild sogo.3.2.7 rpms using SOGo-3.2.7.tag.gz and sogo-3.2.8.20170328-1.centos6.src.rpm adapting the spec file.. any hint?

ludovic

ludovic

2017-04-01 11:50

administrator   ~0011655

Get the tar.gz. Also use 3.2.8, NOT 3.2.7.

nenonano

nenonano

2017-04-01 12:28

reporter   ~0011656

well, trying to rebuild all the rpms is quite difficult because of dependencies
out of ideas

is there any way to have the rpms available before march 23?

ludovic

ludovic

2017-04-01 12:29

administrator   ~0011657

no

nenonano

nenonano

2017-04-01 12:31

reporter   ~0011658

fine :-)

installing sogo-debuginfo package can make any difference and/or give me some tools to debug the issue?

nenonano

nenonano

2017-04-03 09:39

reporter   ~0011665

sending email using TB doesn't have any issue
using roundcube on the same server to send an email with both To: and Bcc: recipients gives no issues at all..

so the problem is with sogo and I need some hints to debug it
I didn't manage in rebuild rpm (and searching with google I found that I'm not the only one)

is there any log/debug facility I should/could enable to have some usefull elements?

ludovic

ludovic

2017-04-03 10:37

administrator   ~0011666

I said to compile/install SOGo from source, not to rebuild the RPM.

One test you could do is to send two messages, as identical as they can be (same subject, content, etc.). One with and one without the bcc.

Gzip the files and attach them to this ticket.

nenonano

nenonano

2017-04-03 11:56

reporter   ~0011668

I said to compile/install SOGo from source, not to rebuild the RPM.

and I ask for hints about recompiling it on centos, since the documentation is for debian :-)

Gzip the files and attach them to this ticket.
which files? the one in the recipient's mailbox? the one from sender's mailbox?

Thank you

nenonano

nenonano

2017-04-03 12:13

reporter  

mail_only_to.tgz (1,108 bytes)
nenonano

nenonano

2017-04-03 12:14

reporter  

mail_to_bcc.tgz (1,110 bytes)
nenonano

nenonano

2017-04-03 12:15

reporter   ~0011669

attached 2 identical emails

the first sent only to To:, the second to To: and Bcc:

retrieved from the inbox of the to: recipient

HTH

nenonano

nenonano

2017-04-03 13:44

reporter   ~0011670

this works:

MIME-Version: 1.0
User-Agent: SOGoMail 3.2.8
From: "Local Administrator" <admin@comune.fasano.br.it>
To: zamboni@mind-at-work.it
Subject: test
Message-ID: <27ab-58e23880-df-2640de40@81310868>
Content-Type: multipart/alternative; boundary="----=_=-_OpenGroupware_org_NGMime-10155-1491220654.554570-114------"

and this is from the corrupted message:
MIME-Version: 1.0Content-Type: multipart/alternative; boundary="----=_=-_OpenGroupware_org_NGMime-10155-1491220686.784490-115------"
User-Agent: SOGoMail 3.2.8
From: "Local Administrator" <admin@comune.fasano.br.it>
To: zamboni@mind-at-work.it
Subject: test
Message-ID: <27ab-58e23900-e1-2640de40@81310908>

the Content-Type: header is wrongly positioned.. it's on the same line of the MIME-Version one

nenonano

nenonano

2017-04-04 08:50

reporter   ~0011674

just tested on your demo online and.. the same issue is there.. so, definitely, it's not an issue on my side :-)

nenonano

nenonano

2017-04-05 09:42

reporter   ~0011678

sorry to bother you but may I ask what's the status of this bug?

nenonano

nenonano

2017-04-05 17:19

reporter  

to.png (171,436 bytes)   
to.png (171,436 bytes)   
nenonano

nenonano

2017-04-05 17:19

reporter  

bcc.png (170,743 bytes)   
bcc.png (170,743 bytes)   
jbd

jbd

2017-04-06 14:04

reporter   ~0011684

Hello,

I,ve the problem too.

Ubunutu 14.04.5 LTS. Version 3.2.7 (@shiva.inverse 201703081122)

look here:
------=_=-_OpenGroupware_org_NGMime-17986-1491478508.624425-14------
Content-Type: text/plain; charset=utf-8
Content-Length: 936
Content-Transfer-Encoding: quoted-printable

Mit freundlichen Gr=C3=BC=C3=9Fen

Jan Boy Dietrich

--
Mit freundlichen Grüßen

Jan Boy Dietrich

francis

francis

2017-04-06 14:19

administrator   ~0011685

Try to update the SOPE packages.

ludovic

ludovic

2017-04-06 15:05

administrator   ~0011686

It's a package mismatch issue in the first place.

A 'safety fix' was pushed to avoid user mistakes.

Related Changesets

sogo: master f83d6a20

2017-04-06 11:02

ludovic


Details Diff
(fix) protect ourself from broken SOPE/SOGo installs (fixes 0004117) Affected Issues
0004117
mod - SoObjects/SOGo/SOGoMailer.m Diff File

sogo: v2 d9d4808d

2017-04-06 11:02

ludovic


Details Diff
(fix) protect ourself from broken SOPE/SOGo installs (fixes 0004117) Affected Issues
0004117
mod - SoObjects/SOGo/SOGoMailer.m Diff File

Issue History

Date Modified Username Field Change
2017-03-29 11:29 nenonano New Issue
2017-03-29 11:29 nenonano File Added: Senzanome.png
2017-03-29 12:53 ludovic Severity major => minor
2017-03-29 12:53 ludovic Note Added: 0011612
2017-03-29 15:01 nenonano Note Added: 0011624
2017-03-29 15:02 ludovic Note Added: 0011625
2017-03-29 15:17 nenonano File Added: email_source.txt
2017-03-29 15:18 nenonano Note Added: 0011626
2017-03-29 16:47 ludovic Note Added: 0011627
2017-03-29 17:19 nenonano File Added: mail.tgz
2017-03-30 08:51 nenonano Note Added: 0011630
2017-03-30 14:57 nenonano Note Added: 0011631
2017-03-30 15:06 nenonano File Added: mail1.tgz
2017-03-30 15:06 nenonano Note Added: 0011632
2017-03-30 15:17 ludovic Note Added: 0011633
2017-03-30 22:18 nenonano Note Added: 0011637
2017-04-01 11:21 nenonano Note Added: 0011650
2017-04-01 11:30 nenonano Note Added: 0011651
2017-04-01 11:32 ludovic Note Added: 0011652
2017-04-01 11:35 nenonano Note Added: 0011653
2017-04-01 11:42 nenonano Note Added: 0011654
2017-04-01 11:50 ludovic Note Added: 0011655
2017-04-01 12:28 nenonano Note Added: 0011656
2017-04-01 12:29 ludovic Note Added: 0011657
2017-04-01 12:31 nenonano Note Added: 0011658
2017-04-03 09:39 nenonano Note Added: 0011665
2017-04-03 10:37 ludovic Note Added: 0011666
2017-04-03 11:56 nenonano Note Added: 0011668
2017-04-03 12:13 nenonano File Added: mail_only_to.tgz
2017-04-03 12:14 nenonano File Added: mail_to_bcc.tgz
2017-04-03 12:15 nenonano Note Added: 0011669
2017-04-03 13:44 nenonano Note Added: 0011670
2017-04-04 08:50 nenonano Note Added: 0011674
2017-04-05 09:42 nenonano Note Added: 0011678
2017-04-05 17:19 nenonano File Added: to.png
2017-04-05 17:19 nenonano File Added: bcc.png
2017-04-06 14:04 jbd Note Added: 0011684
2017-04-06 14:19 francis Note Added: 0011685
2017-04-06 15:03 ludovic Changeset attached => sogo master f83d6a20
2017-04-06 15:03 ludovic Assigned To => ludovic
2017-04-06 15:03 ludovic Resolution open => fixed
2017-04-06 15:04 ludovic Changeset attached => sogo v2 d9d4808d
2017-04-06 15:05 ludovic Note Added: 0011686
2017-04-06 15:05 ludovic Status new => resolved
2017-04-06 15:05 ludovic Resolution fixed => no change required