Convert Java ArrayList of objects to scala seq

Question

I have ArrayList in Java which holds objects of type Row such as following

List<Row> Table = new ArrayList<Row>();

I need to convert this Table to Scala Seq in order to later convert it to data-frame. I tried the following without success

var TableScala:Seq[Row] = 
            Table.asScalaJavaConverters.asScalaBufferConverter(getTable).asScala

val newList = TableScala.map(row => new Tuple5(row(0), row(1), row(2), row(3), row(4)))
spark.createDataFrame(newList).toDF("userID")

Salim Ahmed · Accepted Answer · 2018-04-03 06:24:55Z

1

From Scala 2.8.1, these conversions are made explicit using “scala.collection.JavaConverters._” api. The following code shows same conversion using this api.

First import

import scala.collection.JavaConverters._

Java list

List<Row> javaList = new ArrayList<Row>();

Use “asScala “ to convert Java list to Scala list

val scalaList = javaList.asScala
val squareList = scalaList.map(value => value*value)
println("square list is" + squareList)

reference : http://blog.madhukaraphatak.com/converting-java-collections-to-scala/

answered Apr 3, 2018 at 6:24

Salim Ahmed

838 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

mor Over a year ago

Thanks but I still can not convert squareList to data frame

Collectives™ on Stack Overflow

Convert Java ArrayList of objects to scala seq

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related