'Building Cube in Apache Kylin hangs on the second step
I am trying to buld a Cube in Kylin.
It successfully does the first step and then just keeps running always at 50%
Log from the step 2:
2022-05-13 13:54:40,640 WARN [pool-1-thread-1] util.NativeCodeLoader : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2022-05-13 13:54:42,066 INFO [pool-1-thread-1] application.SparkApplication : Executor task org.apache.kylin.engine.spark.job.CubeBuildJob with args :
....
2022-05-13 13:55:09,993 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr % Total % Received % Xferd Average Speed Time Time Time Current
2022-05-13 13:55:09,993 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr Dload Upload Total Spent Left Speed
2022-05-13 13:55:09,993 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr
2022-05-13 13:55:09,993 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2022-05-13 13:55:09,993 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 100 3001 0 3001 0 0 552k 0 --:--:-- --:--:-- --:--:-- 586k
2022-05-13 13:55:09,993 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : Thread wait for executing command curl -k --negotiate -u : "http://0.0.0.0:8088/ws/v1/cluster/scheduler"
2022-05-13 13:55:09,997 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Queue available capacity: 0.5.
2022-05-13 13:55:09,997 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Estimate total cluster resource is ResourceInfo(6144,2147483647).
2022-05-13 13:55:09,997 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Cluster available capacity: 0.5.
2022-05-13 13:55:09,997 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Capacity actual available resource: AvailableResource(ResourceInfo(3072,1073741823),ResourceInfo(6144,2147483647)).
2022-05-13 13:55:10,744 INFO [pool-1-thread-1] util.log : Logging initialized @31412ms
2022-05-13 13:55:10,817 INFO [pool-1-thread-1] server.Server : jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
2022-05-13 13:55:10,837 INFO [pool-1-thread-1] server.Server : Started @31504ms
2022-05-13 13:55:10,856 WARN [pool-1-thread-1] util.Utils : Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
2022-05-13 13:55:10,863 INFO [pool-1-thread-1] server.AbstractConnector : Started ServerConnector@6a7b60d5{HTTP/1.1,[http/1.1]}{0.0.0.0:4041}
2022-05-13 13:55:10,898 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@75716f1{/jobs,null,AVAILABLE,@Spark}
2022-05-13 13:55:10,898 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@4496293a{/jobs/json,null,AVAILABLE,@Spark}
2022-05-13 13:55:10,899 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@699200e7{/jobs/job,null,AVAILABLE,@Spark}
After some time no new logs come in anymore.
What can I do do debug or find an error?
I am using Kylin from Docker container: https://kylin.apache.org/docs/install/kylin_docker.html
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
Solution | Source |
---|