Re: (ITS#7413) Some UTF-8 characters are wrongly recognized as identical in multi-valued attributes

[michail.bachmann@cms.hu-berlin.de]

--nextPart1483759.4qzvGhZdbd
Content-Type: Text/Plain;
  charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

On Thursday 11 October 2012, Howard Chu wrote:
> m.bachmann@cms.hu-berlin.de wrote:
> > Full_Name: Michail Bachmann
> > Version: 2.4.31
> > OS: Linux
> > URL: ftp://ftp.openldap.org/incoming/
> > Submission from: (NULL) (141.20.3.158)
> >
> >
> >
> > The UTF-8 character 'FEMININE ORDINAL INDICATOR' (U+00AA) is wrongly tr=
eated as
> > 'LATIN SMALL LETTER A' (U+0061), so adding a multi-valued attribute whe=
re U+00AA
> > is replaced with U+0061 (or the other way around) fails:
>=20
> This works as designed. See the Unicode specification, rules for decompos=
ition.

Ah, ok.

Thank you for your time and sorry for the noise.

> >
> > $ ldapadd -f create.ldif -h localhost -D 'cn=3Dadmin,dc=3Dexample,dc=3D=
com'
> >
> > ### create.ldif ###
> > dn: cn=3Dtest,dc=3Dexample,dc=3Dcom
> > objectClass: organizationalRole
> > objectClass: top
> > cn: test
> > street: a street
> > ### /create.ldif ###
> >
> > $ ldapmodify -f modify.ldif -h localhost -D 'cn=3Dadmin,dc=3Dexample,dc=
=3Dcom'
> >
> > ### modify.ldif ###
> > dn: cn=3Dtest,dc=3Dexample,dc=3Dcom
> > changetype: modify
> > add: street
> > street: =C2=AA street
> > -
> >
> > ### /modify.ldif ###
> >
> > will result in
> >
> > ldap_modify: Type or value exists (20)
> >          additional info: modify/add: street: value #0 already exists
> >
> > It seems like U+00AA is decomposed into '<super>+U+0061' and then the '=
<super>'
> > part is discarded.
> >
> > Tested with 2.4.31 (Debian) and 2.4.21 (Ubuntu)
> >
> >
> >
>=20
>=20
>=20


--nextPart1483759.4qzvGhZdbd
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Disposition: attachment; filename="smime.p7s"
Content-Transfer-Encoding: base64

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIOYTCCBCEw
ggMJoAMCAQICAgDHMA0GCSqGSIb3DQEBBQUAMHExCzAJBgNVBAYTAkRFMRwwGgYDVQQKExNEZXV0
c2NoZSBUZWxla29tIEFHMR8wHQYDVQQLExZULVRlbGVTZWMgVHJ1c3QgQ2VudGVyMSMwIQYDVQQD
ExpEZXV0c2NoZSBUZWxla29tIFJvb3QgQ0EgMjAeFw0wNjEyMTkxMDI5MDBaFw0xOTA2MzAyMzU5
MDBaMFoxCzAJBgNVBAYTAkRFMRMwEQYDVQQKEwpERk4tVmVyZWluMRAwDgYDVQQLEwdERk4tUEtJ
MSQwIgYDVQQDExtERk4tVmVyZWluIFBDQSBHbG9iYWwgLSBHMDEwggEiMA0GCSqGSIb3DQEBAQUA
A4IBDwAwggEKAoIBAQDpm8NnhfkNrvWNVMOWUDU9YuluTO2U1wBblSJ01CDrNI/W7MAxBAuZgeKm
FNJSoCgjhIt0iQReW+DieMF4yxbLKDU5ey2QRdDtoAB6fL9KDhsAw4bpXCsxEXsM84IkQ4wcOItq
aACa7txPeKvSxhObdq3u3ibo7wGvdA/BCaL2a869080UME/15eOkyGKbghoDJzANAmVgTe3RCSMq
ljVYJ9N2xnG2kB3E7f81hn1vM7PbD8URwoqDoZRdQWvY0hD1TP3KUazZve+Sg7va64sWVlZDz+HV
Ez2mHycwzUlU28kTNJpxdcVs6qcLmPkhnSevPqM5OUhqjK3JmfvDEvK9AgMBAAGjgdkwgdYwcAYD
VR0fBGkwZzBloGOgYYZfaHR0cDovL3BraS50ZWxlc2VjLmRlL2NnaS1iaW4vc2VydmljZS9hZl9E
b3dubG9hZEFSTC5jcmw/LWNybF9mb3JtYXQ9WF81MDkmLWlzc3Vlcj1EVF9ST09UX0NBXzIwHQYD
VR0OBBYEFEm3xs/oPR9/6kR7Eyn38QpwPt5kMB8GA1UdIwQYMBaAFDHDeRu69VPXF+CJei0XbAqz
K50zMA4GA1UdDwEB/wQEAwIBBjASBgNVHRMBAf8ECDAGAQH/AgECMA0GCSqGSIb3DQEBBQUAA4IB
AQA74Vp3wEgX3KkY7IGvWonwvSiSpspZGBJw7Cjy565/lizn8l0ZMfYTK3S9vYCyufdnyTmieTvh
ERHua3iRM347XyYndVNljjNj7s9zw7CSI0khUHUjoR8Y4pSFPT8z6XcgjaK95qGFKUD2P3MyWA0J
a6bahWzAP7uNZmRWJE6uDT8yNQFb6YyC2XJZT7GGhfF0hVblw/hc843uR7NTBXDn5U2KaYMo4RMJ
hp5eyOpYHgwf+aTUWgRo/Sg+iwK2WLX2oSw3VwBnqyNojWOl75lrXP1LVvarQIc01BGSbOyHxQoL
BzNytG8MHVQs2FHHzL8w00Ny8TK/jM5JY6gA9/IcMIIE9DCCA9ygAwIBAgIEC2I0jzANBgkqhkiG
9w0BAQUFADBaMQswCQYDVQQGEwJERTETMBEGA1UEChMKREZOLVZlcmVpbjEQMA4GA1UECxMHREZO
LVBLSTEkMCIGA1UEAxMbREZOLVZlcmVpbiBQQ0EgR2xvYmFsIC0gRzAxMB4XDTA3MTEyMDEwMjky
MVoXDTE5MDYzMDAwMDAwMFowaDELMAkGA1UEBhMCREUxKDAmBgNVBAoTH0h1bWJvbGR0LVVuaXZl
cnNpdGFldCB6dSBCZXJsaW4xDjAMBgNVBAMTBUhVLUNBMR8wHQYJKoZIhvcNAQkBFhBwa2lAaHUt
YmVybGluLmRlMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA6wxB17AojABvR7rEkR8v
3wfquJ1RAGBx9Bhv0pQis98kCJaaYYO1cspc0znfEAOcBk9lBhb/sWfV13KFKDcib7WlY1sFBHCJ
AbGkpcNTfqp/enTtDZOzXFUzXOj5+lcaHwn6qt2HQ7oafm8wfPp9efd3ykRzCWhbZ7K3o/kCCMHw
5Dxe9na4OdQCXqwp6Hhpmx9CGHq2SPWxrRZqdZJzmfhmDV3yVYghIuyHN/jDTorshki3pWF3OFHp
ok1w09LKPDUZRdHZzUt7ZIZYEwdvjVAKJAsHyKjzrASRfHJgXvJQLENcBJwPGXfJGMSXj3AcS9Cj
wQdtMlyDsU4D5RV4BQIDAQABo4IBsjCCAa4wEgYDVR0TAQH/BAgwBgEB/wIBATALBgNVHQ8EBAMC
AQYwHQYDVR0OBBYEFB/1LD73QKsukKBq0+J5XvJ2zYN0MB8GA1UdIwQYMBaAFEm3xs/oPR9/6kR7
Eyn38QpwPt5kMBsGA1UdEQQUMBKBEHBraUBodS1iZXJsaW4uZGUwgYgGA1UdHwSBgDB+MD2gO6A5
hjdodHRwOi8vY2RwMS5wY2EuZGZuLmRlL2dsb2JhbC1yb290LWNhL3B1Yi9jcmwvY2FjcmwuY3Js
MD2gO6A5hjdodHRwOi8vY2RwMi5wY2EuZGZuLmRlL2dsb2JhbC1yb290LWNhL3B1Yi9jcmwvY2Fj
cmwuY3JsMIGiBggrBgEFBQcBAQSBlTCBkjBHBggrBgEFBQcwAoY7aHR0cDovL2NkcDEucGNhLmRm
bi5kZS9nbG9iYWwtcm9vdC1jYS9wdWIvY2FjZXJ0L2NhY2VydC5jcnQwRwYIKwYBBQUHMAKGO2h0
dHA6Ly9jZHAyLnBjYS5kZm4uZGUvZ2xvYmFsLXJvb3QtY2EvcHViL2NhY2VydC9jYWNlcnQuY3J0
MA0GCSqGSIb3DQEBBQUAA4IBAQBO3AOzYN+zVEPJLJHP12+Oa7wzhC2aji1SGLkPHqYnl27d2+Fx
XgOo24p+rC7vS53tLGjE41EfkwEgO+cy4J9mUptTlDqa3gvzkR8C95Yl43fmYd5HJrZ+WqQTVddw
hxnOBCY0f+oW+RmeybR6TYDAQ+ByK6ru6DFPBRQpIejuny75jjm0EZzcPwZZJ+gxObQ67RtMxiFk
6Io6jWRdpy40mDJ39NF1tJqAFxo+3hSKVRTVs1l/ML12lLmTq+tgri9bLBEQLwNoaCjGhn2aOMYJ
B0Rd5a31pbiXEZLV4IBylWd5/y3Nfb9q3x+i1lXI05u+oJ3q9ox4PbuuKU3VWIngMIIFQDCCBCig
AwIBAgIHE9HfrnKfDDANBgkqhkiG9w0BAQUFADBoMQswCQYDVQQGEwJERTEoMCYGA1UEChMfSHVt
Ym9sZHQtVW5pdmVyc2l0YWV0IHp1IEJlcmxpbjEOMAwGA1UEAxMFSFUtQ0ExHzAdBgkqhkiG9w0B
CQEWEHBraUBodS1iZXJsaW4uZGUwHhcNMTIwNTE1MTQwMzEwWhcNMTUwNTE1MTQwMzEwWjBnMQsw
CQYDVQQGEwJERTEoMCYGA1UEChMfSHVtYm9sZHQtVW5pdmVyc2l0YWV0IHp1IEJlcmxpbjETMBEG
A1UECxMKQ01TL0FidC4gMTEZMBcGA1UEAxMQTWljaGFpbCBCYWNobWFubjCCASIwDQYJKoZIhvcN
AQEBBQADggEPADCCAQoCggEBANiS1EZ9eoDkVZnlHdoqGKJD6WNnV16udnQKT7j5yHTRo5XnF7LB
3nagMKWopr84yVnqRnRay3O2IhmHsscAisJ4uENXeVed5g9QVBGAKUmUAy3jgcKXJ84PJNYXMy93
YN3tzi2VKwwbpM4pBDfC4FT2V4jsb1jynwH5ayoKpbt8d7oggwL3xr/l90h8gJoNW5LFcIgBKDll
tWaHSHqytquHn859eNNxTDntFbgTgh9RGLaI6Kp+P9XBqrqLFX1ebWe24/MSHw6B2Pw2ny/Vy54A
e3W/7FSxpLDCKllQiSbgqG5eyUWEsTOAG41D4Z56AHKcx8byks8j+A6E1xpCWfMCAwEAAaOCAe4w
ggHqMBwGA1UdIAQVMBMwEQYPKwYBBAGBrSGCLAEBBAICMAkGA1UdEwQCMAAwCwYDVR0PBAQDAgXg
MB0GA1UdJQQWMBQGCCsGAQUFBwMCBggrBgEFBQcDBDAdBgNVHQ4EFgQUALsSnuznKfPHjGGxfAJr
jZmz544wHwYDVR0jBBgwFoAUH/UsPvdAqy6QoGrT4nle8nbNg3QwLAYDVR0RBCUwI4EhbWljaGFp
bC5iYWNobWFubkBjbXMuaHUtYmVybGluLmRlMIGDBgNVHR8EfDB6MDugOaA3hjVodHRwOi8vY2Rw
MS5wY2EuZGZuLmRlL2h1LWJlcmxpbi1jYS9wdWIvY3JsL2NhY3JsLmNybDA7oDmgN4Y1aHR0cDov
L2NkcDIucGNhLmRmbi5kZS9odS1iZXJsaW4tY2EvcHViL2NybC9jYWNybC5jcmwwgZ4GCCsGAQUF
BwEBBIGRMIGOMEUGCCsGAQUFBzAChjlodHRwOi8vY2RwMS5wY2EuZGZuLmRlL2h1LWJlcmxpbi1j
YS9wdWIvY2FjZXJ0L2NhY2VydC5jcnQwRQYIKwYBBQUHMAKGOWh0dHA6Ly9jZHAyLnBjYS5kZm4u
ZGUvaHUtYmVybGluLWNhL3B1Yi9jYWNlcnQvY2FjZXJ0LmNydDANBgkqhkiG9w0BAQUFAAOCAQEA
GrSDIsaKf9b6gt658mbHwV4bMO+YvsqpX8x/vQxRnAp7DvpLiHbAawWlDcOPKqkccmk6egUUeoMQ
GICvA3FjCAJlWdNc3/A9ec1yWD2XEH56/uXWkf3Nny7SqnvMJRxPkwjidc/WP5xmuvsQScDm7Je2
jasRmvS5TFBVjNb/yEI56xBGCr1J+s3WeR8ILHsMXvP8ll9rRXI3GQHqx7jhw0FOFjuXKNdzBgLI
1DMcrAqQZeA8tyQxO0zCe53hHTCoJp3fYxYD5EDT8pM7X0woSdOKUmKl4ezUBNizYW55vx10IbFF
j2VTQnTs3fCgRMyMH4dAm0DBeejarZDbKobPxTGCAiQwggIgAgEBMHMwaDELMAkGA1UEBhMCREUx
KDAmBgNVBAoTH0h1bWJvbGR0LVVuaXZlcnNpdGFldCB6dSBCZXJsaW4xDjAMBgNVBAMTBUhVLUNB
MR8wHQYJKoZIhvcNAQkBFhBwa2lAaHUtYmVybGluLmRlAgcT0d+ucp8MMAkGBSsOAwIaBQCggYcw
GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTIxMDExMTQyMzQzWjAj
BgkqhkiG9w0BCQQxFgQUvEheLrh+IXZtXeaWZ0lHReCaO/MwKAYJKoZIhvcNAQkPMRswGTALBglg
hkgBZQMEAQIwCgYIKoZIhvcNAwcwDQYJKoZIhvcNAQEBBQAEggEAGUem6qtixM8FdGDrjHhOypJh
sbIYybMQMw5UKtWqVkne4VuLIVru8PWqh88D1uW/zpB3I0gZwhlDfiM/2tykwvNUDRAU1BAi19M3
XI8xVt0zi62uAbpD7QeEdbFwGry/7Tz5kgYp1DCjSfSni9FNT2NZVRPe749HhR89SHmUi1SwjDli
LTGTur8KWnnWvJIIK7g5GCzPNpV1zeB6PiBTY5nr9w05Ro/mUgrrPlz4StsOY9eiPhRuEeAbXrnb
4zVnksaDExLf4QyKD3ikK4tadvfVO5Lph4XJySeHE/MiMRRI4gAekLvWZgdLMqeo6xM2nf52+vX6
UefhhpBc5gvH/QAAAAAAAA==

--nextPart1483759.4qzvGhZdbd--