研究目的
Investigating the efficiency and scalability of a block-recursive algorithm for large-scale matrix inversion on the Spark parallel computing platform.
研究成果
The proposed block-recursive algorithm for large-scale matrix inversion on Spark demonstrates remarkable performance improvement over MapReduce-based implementations and exhibits reliability and fault-tolerance capabilities compared to MPI programs. It achieves good scalability and is efficient for inverting extra-large matrices on distributed computing environments.
研究不足
The algorithm's scalability is affected when the number of cores exceeds 48 due to increased time in reading data from remote nodes during the shuffle process.
1:Experimental Design and Method Selection:
The study employs a block-recursive algorithm based on LU decomposition for matrix inversion, optimized for implementation on Spark.
2:Sample Selection and Data Sources:
Four large-scale matrices of uniformly distributed random numbers between 0 and 1 were generated for testing.
3:List of Experimental Equipment and Materials:
The experiments were performed on a cluster composed of commodity servers with specific hardware configurations.
4:Experimental Procedures and Operational Workflow:
The algorithm's performance was evaluated by comparing execution times on clusters with different configurations and under various conditions.
5:Data Analysis Methods:
The precision of the matrix inversion was verified, and the performance was analyzed based on execution time and scalability.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容