Skip to content

Conversation

@WangGuangxin
Copy link
Contributor

No description provided.

@afterincomparableyum
Copy link

Thanks for your hardwork, really appreciate it @WangGuangxin . I know Velox does certain queries where the result does not match with what vanilla spark outputs. Is this the same with Bolt? I think it would be nice to include some docs about any potential mismatches for users to be cautious about

@FelixYBW
Copy link
Contributor

FelixYBW commented Dec 7, 2025

@WangGuangxin can you change the time metric of "total time of" to "time of"

@FelixYBW
Copy link
Contributor

FelixYBW commented Dec 7, 2025

The initial performance number from our test, higher is better FYI.

image

@taiyang-li
Copy link
Contributor

Thanks for your hardwork, really appreciate it @WangGuangxin . I know Velox does certain queries where the result does not match with what vanilla spark outputs. Is this the same with Bolt? I think it would be nice to include some docs about any potential mismatches for users to be cautious about

@afterincomparableyum thank you for your suggestion. We would add those documents later before this PR is merged.

@taiyang-li taiyang-li added the BOLT label Dec 8, 2025
@FelixYBW
Copy link
Contributor

FelixYBW commented Dec 9, 2025

Can you create similar documents as Velox? here is the list of Velox docs.

docs/developers/ProfileMemoryOfGlutenWithVelox.md
docs/developers/velox-backend-CI.md
docs/developers/velox-backend-build-in-docker.md
docs/developers/velox-function-development-guide.md
docs/developers/VeloxDynamicSizingOffheap.md
docs/developers/VeloxUDF.md
docs/get-started/VeloxABFS.md
docs/get-started/VeloxGCS.md
docs/get-started/VeloxIceberg.md
docs/get-started/VeloxLocalCache.md
docs/get-started/VeloxQAT.md
docs/get-started/VeloxS3.md
docs/get-started/VeloxStageResourceAdj.md
docs/get-started/Velox.md
docs/get-started/VeloxGPU.md
docs/image/velox_apply_stage_resource.png
docs/image/velox_decision_support_bench1_10query_performance.png
docs/image/velox_decision_support_bench1_22queries_performance.png
docs/image/velox_profile_memory_gif.gif
docs/image/velox_profile_memory_text.png
docs/image/veloxbe_memory_layout.png
docs/velox-backend-aggregate-function-support.md
docs/velox-backend-generator-function-support.md
docs/velox-backend-limitations.md
docs/velox-backend-troubleshooting.md
docs/velox-backend-window-function-support.md
docs/velox-parquet-write-configuration.md
docs/velox-spark-configuration.md
docs/velox-backend-scalar-function-support.md
docs/velox-backend-support-progress.md
docs/velox-configuration.md

@FelixYBW
Copy link
Contributor

FelixYBW commented Dec 9, 2025

Does Bolt passes Spark3.2, 3.3, 3.4 and 3.5 UTs?

We are going to drop 3.2 support and fixing 4.0 UTs. So Bolt may starts from 3.3 support.

@WangGuangxin WangGuangxin force-pushed the add_bolt_backend branch 2 times, most recently from b871610 to be4494f Compare December 11, 2025 03:27
@taiyang-li
Copy link
Contributor

Does Bolt passes Spark3.2, 3.3, 3.4 and 3.5 UTs?

We are going to drop 3.2 support and fixing 4.0 UTs. So Bolt may starts from 3.3 support.

Currently we mainly run UTs on spark3.5. For now most of 3.5 cound be passed, and we are fixing failed uts. We will follow the community's support for different spark versions.

taiyang-li and others added 3 commits December 11, 2025 17:03
* add make argument for specifing  Bolt's version(branch/tag)
* minor fix
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants