How to create a TABLE with SELECT from another TABLE in spark using SQL

Question

I have a table saved in HDFS called usedcars. I want to create another table based on the output of a select statement on this table as follows

%spark.sql
CREATE TABLE cleanusedcars
AS (
select (maker, model, mileage, manufacture_year, engine_displacement, engine_power, transmission, door_count, seat_count, fuel_type, date_created, date_last_seen, price_eur)
from usedcars
where maker is not null and model is not null and price_eur <= 2000000 and price_eur >= 3000 and manufacture_year <= 2017 and manufacture_year >= 2000
)

I am using spark SQL in a zeppelin notebook. The error I am getting is Error message

Please help! Thanks.

mck · Accepted Answer · 2021-02-20 16:37:15Z

1

Remove the parenthesis from select(...). If you include parenthesis, the select statement will be interpreted as selecting a single struct column of all the columns you have selected.

answered Feb 20, 2021 at 16:37

mck

42.7k13 gold badges44 silver badges62 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to create a TABLE with SELECT from another TABLE in spark using SQL

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related