Discuss big data frameworks/technologies such as Hadoop, Spark, etc.
Forums
apache-lucene .net azure
azure-functions azure .net
Hi Andrey,
My knowledge in HBase is basic hence won't be able to suggest much in this domain. Is the network I/O slow between your clusters? And also are your slave (replication target) clusters down?
Markdown is now supported.
Refer to article: New feature - Markdown editor
Thanks for sharing AJ and welcome to Kontext. If you want to be even more accurate, you can also consider milliseconds as there might be possibilities that some purchases will land on the last second.
the best way to avoid this if by using the Month function of sql (you can query using SqlDataAdapter or SqlCommand at your like)
SELECT
* FROM
myOrders WHERE MONTH
(date_column) = 12 AND YEAR
(date_column) = 2022;
This will be more accurate and give you all records of December 2022 no matter the time ;)
monthEnd
and lastMonthEnd
to:var
monthEnd = monthStart.AddMonths(1).AddSeconds(-1);
var lastMonthEnd = monthStart.AddSeconds(-1);
This will output for example (it's January 2023)monthEnd
= 1/31/2023 11:59:59 PMlastMonthEnd
= 12/31/2022 11:59:59 PM
This works in my shop in the case let's say I registered a purchase on 12/31/2022 10:05 AM, the LastMonthEnd will originally output the last day of the month but just at 12/31/2022 12:00:00 AM, so when you look up for records of December 2022 that purchase won't count.
If not expert with queries (like me) we would normally search between two dates with '<=' and '>=' operators and this won't count that purchase unless using the edit above, for example I used LINQ to count my purchases of the current month in a filled DataTable:
int currMonthOrders = dataSet1.myOrders.AsEnumerable().Where(row => row.Field<DateTime>("yourDateColumn") >= monthStart && row.Field<DateTime>("yourDateColumn") <= monthEnd).Count(); label1.Text = "You have done " +currMonthOrders.ToString("N0")+ " purchases this month";
I'm glad it works for you.
Thanks Kontext. I have tried to follow that web https://kontext.tech/article/1060/pyspark-read-data-from-oracle-database
That was successful.
Version of jdk is 1.8.0_352, open jdk 64-bit server VM.
All of logs I have shown above when I ran that statement code.
Did you follow the exact steps in the guide? The error you encounter usually is caused by that fact the file to unzip us big a zip file. You can try downloading the file through browser and then unzip using GUI tools like 7zip and then follow other steps to install.
I uninstalled everything then tried again and got this exception:-
"New-Object : Exception calling ".ctor" with "3" argument(s): "Zip 64 End of Central Directory Record not where
indicated."
At
C:\WINDOWS\system32\WindowsPowerShell\v1.0\Modules\Microsoft.PowerShell.Archive\Microsoft.PowerShell.Archive.psm1:934
char:23
+ ... ipArchive = New-Object -TypeName System.IO.Compression.ZipArchive -Ar ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : InvalidOperation: (:) [New-Object], MethodInvocationException
+ FullyQualifiedErrorId : ConstructorInvokedThrowException,Microsoft.PowerShell.Commands.NewObjectCommand"
So my system is still trying to use the "C" drive, didn't get this last time but it installed correctly, just on my C drive.
Discuss about cloud computing technologies, learning resources, etc.
This forum is for general programming, development related discussions.
Any Kontext website related questions, please publish here incl. feature suggestions, bug reports, other feedbacks, etc. Visit Help Centre to learn how to use Kontext platform efficiently.
Hi Raymond, tanks for quick pick-up on the question. Yes, the slaves are up and as of slow network - let me check on the monitoring, let's see if there are any bottlenecks. Will update after checks )