{"task": {"agent_timeout": 3000, "task": "pandas-dev__pandas-51854", "verifier_timeout": 6000, "instruction": "BUG: Pandas 2.0rc0 can't handle string column with PyArrow (large_string error)\n### Pandas version checks\n\n- [X] I have checked that this issue has not already been reported.\n\n- [X] I have confirmed this bug exists on the [latest version](https://pandas.pydata.org/docs/whatsnew/index.html) of pandas.\n\n- [ ] I have confirmed this bug exists on the [main branch](https://pandas.pydata.org/docs/dev/getting_started/install.html#installing-the-development-version-of-pandas) of pandas.\n\n\n### Reproducible Example\n\n```python\nimport polars as pl\nfrom datetime import datetime\n\ndataframe = pl.DataFrame({\"integer\": [1, 2, 3], \n                          \"date\": [\n                              (datetime(2022, 1, 1)), \n                              (datetime(2022, 1, 2)), \n                              (datetime(2022, 1, 3))\n                          ], \n                          \"float\":[4.0, 5.0, 6.0],\n                          \"strings\": [\"first\", \"second\", \"third\"]\n                        })\n\ndf_pd_pyarrow = dataframe.to_pandas(use_pyarrow_extension_array=True)\n\n\n#ERROR *** NotImplementedError: large_string ***\n```\n\n\n### Issue Description\n\nHi guys!\nPolars is another tool to work with dataframes.\n\nWhen converting to Pandas, one dataframe in PyArrow (generated by Polars), which has one column with string datatype, I got this error:\n\n`NotImplementedError: large_string`\n\nThis only occurs in Pandas 2.0rc0.\nWith Pandas 1.5.3 it works without error.\n\n[This not appears to be a Polars' bug, as whats was tested here](https://github.com/pola-rs/polars/issues/7431)\n\n### Expected Behavior\n\nIt's supposed to work, as its works with v 1.5.3\n\n### Installed Versions\n\n<details>\n\n```\npandas.show_versions()\u00a0\nINSTALLED VERSIONS\n#------------------\ncommit\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 1a2e300170efc08cb509a0b4ff6248f8d55ae777\npython\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 3.10.6.final.0\npython-bits\u00a0\u00a0\u00a0\u00a0\u00a0 : 64\nOS\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : Linux\nOS-release\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 5.10.16.3-microsoft-standard-WSL2\nVersion\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : #1 SMP Fri Apr 2 22:23:49 UTC 2021\nmachine\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : x86_64\nprocessor\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : x86_64\nbyteorder\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : little\nLC_ALL\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nLANG\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : C.UTF-8\nLOCALE\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : en_US.UTF-8\u00a0\npandas\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 2.0.0rc0\nnumpy\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 1.24.2\npytz\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 2022.7.1\ndateutil\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 2.8.2\nsetuptools\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 59.6.0\npip\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 22.0.2\nCython\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\npytest\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nhypothesis\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nsphinx\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nblosc\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nfeather\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nxlsxwriter\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nlxml.etree\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nhtml5lib\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\npymysql\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\npsycopg2\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\njinja2\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 3.1.2\nIPython\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 8.11.0\npandas_datareader: None\nbs4\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 4.11.2\nbottleneck\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nbrotli\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nfastparquet\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nfsspec\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\ngcsfs\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nmatplotlib\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nnumba\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nnumexpr\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nodfpy\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nopenpyxl\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\npandas_gbq\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\npyarrow\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 11.0.0\npyreadstat\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\npyxlsb\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\ns3fs\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nscipy\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nsnappy\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nsqlalchemy\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : 2.0.5.post1\ntables\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\ntabulate\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nxarray\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nxlrd\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nzstandard\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\ntzdata\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\nqtpy\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\npyqt5\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 : None\n\n```\n</details>\n", "memory": "8192m", "runnable": false, "difficulty": "hard", "language": "", "cpus": 1, "instruction_truncated": false, "category": "debugging", "compose": false, "has_solution": true, "oracle": null, "docker_image": "", "taskset": "swegym", "tags": ["debugging", "swe-bench"]}, "runs": []}