Netsuite JDBC pyspark error - SQLSyntaxErrorException: Syntax Error in the SQL statement

Question

I'm trying to test the jdbc connection by querying our Customer netsuite table with spark jdbc in Databricks. I've added the .jar file to the cluster and trying to run the below. I tried with the schema in the query also... but our schema is "FL - Accounting" so maybe I didn't add it correctly?

jdbc_url = "jdbc:ns://xxxx.connect.api.netsuite.com:1708;ServerDataSource=NetSuite2.com;Encrypted=1;NegotiateSSLClose=false;CustomProperties=(AccountID=xxxx;RoleID=xxx)"


netsuite_query= f"""
(
SELECT TOP 10 * FROM Customer
) AS t
"""

try:
    print(f"Attempting to read using the query: {netsuite_query}")


df = spark.read \
.format("jdbc") \
.option("url", jdbc_url) \
.option("dbtable", netsuite_query) \
.option("user", "xxxx") \
.option("password", "xxx") \
.option("driver", "com.netsuite.jdbc.openaccess.OpenAccessDriver") \
.load()

display(df)

except Exception as e:
    raise e

Note I also tried with:

\

.option("query", netsuite_query) \
.option("dbtable", "oa_tables") \

Please provide the full error. Also, is TOP 10 actually valid syntax in NetSuite? — Mark Rotteveel
– Mark Rotteveel, Commented Jun 28 at 11:11
@siggemannen - I tried that also, I also tried with SELECT * FROM oa_tables; but same error — KristiLogos
– KristiLogos, Commented Jun 30 at 9:37
@MarkRotteveel - that's the entire error message I see unfortunately. — KristiLogos
– KristiLogos, Commented Jun 30 at 9:37

KristiLogos · Accepted Answer · 2025-06-30 10:58:42Z

0

I took a closer look and it looks like the issue was happening for me at the display() part, so I removed that and saved the results to a csv and that worked!

        .load() \
        .write \
        .format("csv") \
        .option("header", "true") \
        .mode("overwrite") \
        .save(output_path)

answered Jun 30 at 10:58

KristiLogos

131 silver badge5 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Netsuite JDBC pyspark error - SQLSyntaxErrorException: Syntax Error in the SQL statement

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related