text-comparison

Pyspark find the nearest text Question: I’m a new user for pyspark. I want to compare text from two different dataframes (containing news information) for recommendation. I was able to do this very easily with Python: def get_recommendations(title, cosine_sim, indices): idx = indices[title] # Get the pairwsie similarity scores sim_scores = list(enumerate(cosine_sim[idx])) print(sim_scores) # Sort …