Raymond Raymond | Spark & PySpark

Spark SQL - Convert String to Date

event 2020-10-23 visibility 22,444 comment 0 insights toc
more_vert
insights Stats
toc Table of contents

In Spark, function to_date can be used to convert string to date. This function is available since Spark 1.5.0.

Code snippet

SELECT to_date('2020-10-23', 'yyyy-MM-dd');
SELECT to_date('23Oct2020', 'ddMMMyyyy');

Datetime patterns

Refer to the official documentation about all the datetime patterns. 

https://spark.apache.org/docs/latest/sql-ref-datetime-pattern.html

SymbolMeaningPresentationExamples
GeratextAD; Anno Domini
yyearyear2020; 20
Dday-of-yearnumber(3)189
M/Lmonth-of-yearmonth7; 07; Jul; July
dday-of-monthnumber(3)28
Q/qquarter-of-yearnumber/text3; 03; Q3; 3rd quarter
Eday-of-weektextTue; Tuesday
Faligned day of week in monthnumber(1)3
aam-pm-of-dayam-pmPM
hclock-hour-of-am-pm (1-12)number(2)12
Khour-of-am-pm (0-11)number(2)0
kclock-hour-of-day (1-24)number(2)0
Hhour-of-day (0-23)number(2)0
mminute-of-hournumber(2)30
ssecond-of-minutenumber(2)55
Sfraction-of-secondfraction978
Vtime-zone IDzone-idAmerica/Los_Angeles; Z; -08:30
ztime-zone namezone-namePacific Standard Time; PST
Olocalized zone-offsetoffset-OGMT+8; GMT+08:00; UTC-08:00;
Xzone-offset ‘Z’ for zerooffset-XZ; -08; -0830; -08:30; -083015; -08:30:15;
xzone-offsetoffset-x+0000; -08; -0830; -08:30; -083015; -08:30:15;
Zzone-offsetoffset-Z+0000; -0800; -08:00;
escape for textdelimiter 
’‘single quoteliteral
[optional section start  
]optional section end  


More from Kontext
comment Comments
No comments yet.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts