研究目的
Investigating the efficiency and scalability of a block-recursive algorithm for large-scale matrix inversion on the Spark parallel computing platform.
研究成果
The proposed Spark-based block-recursive matrix inversion algorithm significantly outperforms the MapReduce-based implementation and exhibits reliability and fault-tolerance capabilities compared to the MPI program. It achieves good scalability and is efficient for inverting extra-large matrices on distributed computing environments.
研究不足
The algorithm's scalability is affected when the number of cores exceeds 48 due to increased network communication overhead. The study does not prove Spark is fundamentally superior to MPI or MapReduce but highlights its advantages in certain scenarios.
1:Experimental Design and Method Selection:
The study employs a block-recursive algorithm based on LU decomposition for matrix inversion, optimized for Spark.
2:Sample Selection and Data Sources:
Four large-scale matrices of uniformly distributed random numbers between 0 and 1 were generated for testing.
3:List of Experimental Equipment and Materials:
A cluster composed of commodity servers with specific configurations was used.
4:Experimental Procedures and Operational Workflow:
The algorithm's performance was evaluated on clusters with different configurations, comparing it with MapReduce-based and MPI-based implementations.
5:Data Analysis Methods:
The precision and execution time of the algorithms were analyzed to evaluate performance.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容