visibility 42
thumb_up 0
access_time 29 days ago
more_horiz
visibility 101
thumb_up 0
access_time 6 months ago
more_horiz
visibility 47
thumb_up 0
access_time 7 months ago
more_horiz
visibility 91
thumb_up 0
access_time 8 months ago
more_horiz
visibility 126
thumb_up 1
access_time 10 months ago
more_horiz
visibility 236
thumb_up 0
access_time 10 months ago
more_horiz
visibility 2794
thumb_up 0
access_time 10 months ago
more_horiz
visibility 665
thumb_up 0
access_time 3 years ago
more_horiz
visibility 644
thumb_up 0
access_time 3 years ago
more_horiz
visibility 216
thumb_up 1
access_time 3 years ago
more_horiz
#1669 Re: Torchvision error: Could not find module image.pyd access_time3 days ago

Thanks for the confirmation. 

X
xb
#1668 Re: Torchvision error: Could not find module image.pyd access_time3 days ago

Appproch 2 worded for me.

use the vs code. rename image.pyd to image.py.

#1667 Re: Apache Hive 3.1.2 Installation on Linux Guide access_time21 days ago

Can you provide your table creation statement and also the insert statement?

B
B
#1666 Re: Apache Hive 3.1.2 Installation on Linux Guide access_time22 days ago

I Cant Insert rows into my table. When I do the insert statement I get the following error:



Error while compiling statement: Failed:SemanticException 0:0 Expected 2 columns for insclause-0

#1665 Re: how to prevent backslash while writing json file in pyspark access_time29 days ago

It behaves in that way because you have converted the object to JSON string. 

Try the following code to remove to_json and let the final DataFrameWriter to convert it as JSON format properly:

df=df.select(struct("author", "title", "pages", "email").alias("json-data")).agg(collect_list("json-data").alias("list-item"))

The code will generate the following output:

{"list-item":[{"author":"author1","title":"title1","pages":1,"email":"author1@gmail.com"},{"author":"author2","title":"title2","pages":2,"email":"author2@gmail.com"},{"author":"author3","title":"title3","pages":3,"email":"author3@gmail.com"},{"author":"author4","title":"title4","pages":4,"email":"author4@gmail.com"}],"version":1}

H
hedmond
#1663 Re: java.net.SocketException: Permission denied access_time2 months ago

Your Java socket shows SocketTimeoutException means that it takes too long to get respond from other device and your request expires before getting response. This exception is occurring on following condition.

  • Server is slow and default timeout is less, so just put timeout value according to you.
  • Server is working fine but timeout value is for less time. so change the timeout value.

Solution: A java developer can pre-set the timeout option for both client and server operations.

From Client side:

Socket socket = new Socket();

SocketAddress socketAddress = new InetSocketAddress(host, port);

socket.connect(socketAddress, 12000); //12000 are milli seconds


From Server side:

ServerSocket serverSocket = new new ServerSocket(port);

serverSocket.setSoTimeout(12000);



#1660 Re: Connect to MySQL in Spark (PySpark) access_time2 months ago

You need to run some tests to find out.

One is using JDBC and another using Python native driver. I dont think there be much major performance differences as the Spark read from JDBC will not run in parallel anyway. So the main performance differences will be the difference between these two drivers.

If you do want to extract data using JDBC in parallel by utilizing partition columns, you can consider Sqoop.

S
Samuel
#1659 Re: Connect to MySQL in Spark (PySpark) access_time2 months ago

question for you: Is is more or less performant to use the spark only technique of:

spark_df = spark.read.format("jdbc").option("url", "jdbc:mysql://<host_string>/<database>").option("driver", "com.mysql.cj.jdbc.Driver").option("dbtable", "(SELECT * FROM some_table) temp_spark_table").option("user", "theusername").option("password", "thepassword").load()


#1658 Re: 是否支持Markdown格式编辑文章内容 access_time2 months ago

欢迎来到Kontext,Mengz!谢谢您的反馈,目前尚未支持Markdown编辑器,在今后发布的版本中会考虑此功能!

如果你在使用中有发现任何Bug或者可以改进的地方,欢迎告知!

谢谢,

Administrator

#1656 Re: MERGE Statement in BigQuery access_time2 months ago

Thanks for the clarifications. It makes sense.

listForum list

This forum is for general programming, development related discussions.

This forum is created for users to publish training related external information from other websites.

All advertisements about training must be published in this forum only. Otherwise the contents will be blocked. 

Discuss about cloud computing technologies, learning resources, etc. 

Discuss big data frameworks/technologies such as Hadoop, Spark,  etc. 

Any Kontext website related questions, please publish here incl. feature suggestions, bug reports, other feedbacks, etc. Visit Help Centre to learn how to use Kontext platform efficiently.