Incomming E-mail problem - Data too long for column 'title' at row 1

Incomming e-mail from government has a large subject,
but ERPNext not accept it, always rejected, did not showing in communications.
Please resolve this problem.
ORIGINAL SUBJECT:
Átvételi értesítő (Feladó: NAV, Dokumentum: Hibátlan bevallásról értesítés - 518124715201806141802352360 - Címzett: XXXXX XXXXXXXX - 2018.06.14. 18:02:09)

Trace:

{‘retry’: 0, ‘log’: <function log at 0x7efc0552c2a8>, ‘site’: u’site1.local’, ‘event’: None, ‘method_name’: u’frappe.utils.global_search.sync_global_search’, ‘method’: <function sync_global_search at 0x7efc05da18c0>, ‘user’: u’Administrator’, ‘kwargs’: {‘flags’: [{‘name’: ‘59638d41e6’, ‘title’: u’ \xc1tv\xe9teli \xe9rtes\xedt\u0151 (Felad\xf3: NAV, Dokumentum: Elfogad\xf3 nyugta - 518124715201806141716319904 - C\xedmzett: KRN\xc1CS K\xc1ROLYN\xc9 - 2018.06.14. 17:16:11)‘, ‘route’: None, ‘doctype’: u’Communication’, ‘content’: u’Subject : \xc1tv\xe9teli \xe9rtes\xedt\u0151 (Felad\xf3: NAV, Dokumentum: Elfogad\xf3 nyugta - 518124715201806141716319904 - C\xedmzett: KRN\xc1CS K\xc1ROLYN\xc9 - 2018.06.14. 17:16:11) ||| From : ertesites@kozpontirendszer.gov.hu’, ‘published’: 0}]}, ‘async’: True, ‘job_name’: u’frappe.utils.global_search.sync_global_search’}
Traceback (most recent call last):
File “/home/frappe/frappe-bench/apps/frappe/frappe/utils/background_jobs.py”, line 97, in execute_job
method(**kwargs)
File “/home/frappe/frappe-bench/apps/frappe/frappe/utils/global_search.py”, line 316, in sync_global_search
content = %(content)s’‘’, value)
File “/home/frappe/frappe-bench/apps/frappe/frappe/database.py”, line 166, in sql
self._cursor.execute(query, values)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/cursors.py”, line 165, in execute
result = self._query(query)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/cursors.py”, line 321, in _query
conn.query(q)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 860, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 1061, in _read_query_result
result.read()
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 1349, in read
first_packet = self.connection._read_packet()
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 1018, in _read_packet
packet.check_error()
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 384, in check_error
err.raise_mysql_exception(self._data)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/err.py”, line 107, in raise_mysql_exception
raise errorclass(errno, errval)
DataError: (1406, u"Data too long for column ‘title’ at row 1")

Title must be truncated before they get inserted to global search. Seems like a bug. Can you raise this on github issues?

CC: @pratu16x7

Please find on github:

https://github.com/frappe/erpnext/issues/14627

Problem unfortunately not solved:

frappe.utils.global_search.sync_global_search
Hiba
{‘retry’: 0, ‘log’: <function log at 0x7f72742f2320>, ‘site’: u’site1.local’, ‘event’: None, ‘method_name’: u’frappe.utils.global_search.sync_global_search’, ‘method’: <function sync_global_search at 0x7f7274b678c0>, ‘user’: u’Administrator’, ‘kwargs’: {‘flags’: [{‘name’: ‘24fc4a4a90’, ‘title’: u’ \xc1tv\xe9teli \xe9rtes\xedt\u0151 (Felad\xf3: NAV, Dokumentum: Elfogad\xf3 nyugta - 518124715201807091142136403 - C\xedmzett: KRN\xc1CS K\xc1ROLYN\xc9 - 2018.07.09. 11:42:41)‘, ‘route’: None, ‘doctype’: u’Communication’, ‘content’: u’Subject : \xc1tv\xe9teli \xe9rtes\xedt\u0151 (Felad\xf3: NAV, Dokumentum: Elfogad\xf3 nyugta - 518124715201807091142136403 - C\xedmzett: KRN\xc1CS K\xc1ROLYN\xc9 - 2018.07.09. 11:42:41) ||| From : ertesites@kozpontirendszer.gov.hu’, ‘published’: 0}]}, ‘async’: True, ‘job_name’: u’frappe.utils.global_search.sync_global_search’}
Traceback (most recent call last):
File “/home/frappe/frappe-bench/apps/frappe/frappe/utils/background_jobs.py”, line 97, in execute_job
method(**kwargs)
File “/home/frappe/frappe-bench/apps/frappe/frappe/utils/global_search.py”, line 316, in sync_global_search
content = %(content)s’‘’, value)
File “/home/frappe/frappe-bench/apps/frappe/frappe/database.py”, line 166, in sql
self._cursor.execute(query, values)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/cursors.py”, line 165, in execute
result = self._query(query)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/cursors.py”, line 321, in _query
conn.query(q)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 860, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 1061, in _read_query_result
result.read()
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 1349, in read
first_packet = self.connection._read_packet()
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 1018, in _read_packet
packet.check_error()
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/connections.py”, line 384, in check_error
err.raise_mysql_exception(self._data)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pymysql/err.py”, line 107, in raise_mysql_exception
raise errorclass(errno, errval)
DataError: (1406, u"Data too long for column ‘title’ at row 1")

I am having the same issue when upgrading from v11 to v12 after restoring database and executing bench migrate

@aldoblack

Yes it was a problem with python 2.7.
After upgrading to 3.6 this went away.