[asterisk-bugs] [JIRA] (ASTERISK-28069) Dropping CDRs records with local languages

[Asterisk Team (JIRA)]

    [ https://issues.asterisk.org/jira/browse/ASTERISK-28069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=244933#comment-244933 ] 

Asterisk Team commented on ASTERISK-28069:
------------------------------------------

Thanks for creating a report! The issue has entered the triage process. That means the issue will wait in this status until a Bug Marshal has an opportunity to review the issue. Once the issue has been reviewed you will receive comments regarding the next steps towards resolution.

A good first step is for you to review the [Asterisk Issue Guidelines|https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines] if you haven't already. The guidelines detail what is expected from an Asterisk issue report.

Then, if you are submitting a patch, please review the [Patch Contribution Process|https://wiki.asterisk.org/wiki/display/AST/Patch+Contribution+Process].

> Dropping CDRs records with local languages 
> -------------------------------------------
>
>                 Key: ASTERISK-28069
>                 URL: https://issues.asterisk.org/jira/browse/ASTERISK-28069
>             Project: Asterisk
>          Issue Type: Bug
>      Security Level: None
>          Components: CDR/cdr_pgsql
>    Affects Versions: 13.19.0, 13.23.0, 13.23.1
>         Environment: Debian 3.16.51-2
> psql (PostgreSQL) 9.4.15
>            Reporter: Kirill Nikitin
>
> If in CDR record appears local language Asterisk may corrupt data and fail to write them in database.
> How to reproduce:
> 1. Create context in extensions in the database with some line in local language.
> Encoding of database must be UTF-8.
> Example (with Russian):
> 173705
> text-machine	dbd54025c33844fbe672835e5960c0b7	NoOp	------------- Text Machine -------------	
> 1
> 173706
> text-machine	dbd54025c33844fbe672835e5960c0b7	Answer		
> 2
> 173707
> text-machine	dbd54025c33844fbe672835e5960c0b7	Hangup		
> 9
> 173708
> text-machine	dbd54025c33844fbe672835e5960c0b7	AGI	say.php,"Уважаемый Иванов Иван Иванович"	
> 3
> 173709
> text-machine	dbd54025c33844fbe672835e5960c0b7	AGI	say.php,"приглашаем вас пройти профосмотр первого августа"	
> 4
> 173710
> text-machine	dbd54025c33844fbe672835e5960c0b7	AGI	say.php,"по адресу улица казахстанская, дом номер один, кабинет номер двадцать"	
> 5
> 173711
> text-machine	dbd54025c33844fbe672835e5960c0b7	AGI	say.php,"При себе иметь удостоверение личности"	
> 6
> 173712
> text-machine	dbd54025c33844fbe672835e5960c0b7	Wait	5	
> 7
> Since database accept this no special characters in that context exists.
> Initiate a call and drop a call to force asterisk write Russian characters in lastapp field in CDR.
> You will receive:
> [2018-09-18 19:15:04] ERROR[10904]: cdr_pgsql.c:439 pgsql_log: Failed to insert call detail record into database!
> [2018-09-18 19:15:04] ERROR[10904]: cdr_pgsql.c:440 pgsql_log: Reason: ERROR:  invalid byte sequence for encoding "UTF8": 0xd0 0x20
> [2018-09-18 19:15:04] ERROR[10904]: cdr_pgsql.c:441 pgsql_log: Connection may have been lost... attempting to reconnect.
> [2018-09-18 19:15:04] ERROR[10904]: cdr_pgsql.c:444 pgsql_log: Connection reestablished.
> [2018-09-18 19:15:04] ERROR[10904]: cdr_pgsql.c:452 pgsql_log: HARD ERROR!  Attempted reconnection failed.  DROPPING CALL RECORD!
> [2018-09-18 19:15:04] ERROR[10904]: cdr_pgsql.c:453 pgsql_log: Reason: ERROR:  invalid byte sequence for encoding "UTF8": 0xd0 0x20
> Since CDR and context are in the same database - I think this is not database locale settings.
> We test it on different 13.XX versions
> We test in on PostgreSQL 9.4.XX and 9.6.XX
> Byte sequence in error message varies a little, but first byte always 0xd0



--
This message was sent by Atlassian JIRA
(v6.2#6252)