Uncategorized

Accessibility on Android

Accessibility can enhance the usability for all users, including those with low vision, blindness, hearing impairments, cognitive impairments, motor impairments or situational disabilities (such as a broken arm). In addition to soft input methods (such as on-screen keyboards), Android supports physical keyboards attached to the device. A keyboard offers not only a convenient mode for […]

How To

PySpark Word2Vec – Lessons Learned – Part 3

Another setting that I had to change was the spark.driver.maxResultSize. While training the Word2Vec model, Spark job threw a SparkException “Job aborted due to stage failure: Total size of serialized results of x tasks (y MB) is bigger than spark.driver.maxResultSize (z MB)“. This usually happens during the collect stage as the driver needs more memory. […]

How To

PySpark Word2Vec – Lessons Learned – Part 2

The next setting that I had to change was the spark.rpc.message.maxSize. This was changed when I got the following error. Serialized task XXX:XXX was XXX bytes, which exceeds max allowed: spark.rpc.message.maxSize (XXX bytes). Consider increasing spark.rpc.message.maxSize or using broadcast variables for large values. This error comes if there is large data that is being exchanged […]