Analyzing the Load Balance of Term-based Partitioning
M. Ahmad Abusukhon. International Journal of Advanced Computer Science and Applications(IJACSA), (2011)
Аннотация
In parallel (IR) systems, where a large-scale collection is indexed and searched, the query response time is limited by the time of the slowest node in the system. Thus distributing the load equally across the nodes is very important issue. Mainly there are two methods for collection indexing, namely document-based and term-based indexing. In term-based partitioning, the terms of the global index of a large-scale data collection are distributed or partitioned equally among nodes, and then a given query is divided into sub-queries and each sub-query is then directed to the relevant node. This provides high query throughput and concurrency but poor parallelism and load balance. In this paper, we introduce new methods for terms partitioning and then we compare the results from our methods with the results from the previous work with respect to load balance and query response time.
%0 Journal Article
%1 IJACSA.2011.020103
%A Ahmad Abusukhon, Mohammad Talib
%D 2011
%J International Journal of Advanced Computer Science and Applications(IJACSA)
%K Load Node Term-frequency Term-lengthpartitioning,Term-partitioning balance, partitioning, schemes utilization,
%N 1
%T Analyzing the Load Balance of Term-based Partitioning
%U http://ijacsa.thesai.org/
%V 2
%X In parallel (IR) systems, where a large-scale collection is indexed and searched, the query response time is limited by the time of the slowest node in the system. Thus distributing the load equally across the nodes is very important issue. Mainly there are two methods for collection indexing, namely document-based and term-based indexing. In term-based partitioning, the terms of the global index of a large-scale data collection are distributed or partitioned equally among nodes, and then a given query is divided into sub-queries and each sub-query is then directed to the relevant node. This provides high query throughput and concurrency but poor parallelism and load balance. In this paper, we introduce new methods for terms partitioning and then we compare the results from our methods with the results from the previous work with respect to load balance and query response time.
@article{IJACSA.2011.020103,
abstract = { In parallel (IR) systems, where a large-scale collection is indexed and searched, the query response time is limited by the time of the slowest node in the system. Thus distributing the load equally across the nodes is very important issue. Mainly there are two methods for collection indexing, namely document-based and term-based indexing. In term-based partitioning, the terms of the global index of a large-scale data collection are distributed or partitioned equally among nodes, and then a given query is divided into sub-queries and each sub-query is then directed to the relevant node. This provides high query throughput and concurrency but poor parallelism and load balance. In this paper, we introduce new methods for terms partitioning and then we compare the results from our methods with the results from the previous work with respect to load balance and query response time.
},
added-at = {2014-02-21T08:00:08.000+0100},
author = {{Ahmad Abusukhon}, Mohammad Talib},
biburl = {https://www.bibsonomy.org/bibtex/21002a9a93654411a55c860ebf823fabf/thesaiorg},
interhash = {53b288e90679773bc62addc5fd975526},
intrahash = {1002a9a93654411a55c860ebf823fabf},
journal = {International Journal of Advanced Computer Science and Applications(IJACSA)},
keywords = {Load Node Term-frequency Term-lengthpartitioning,Term-partitioning balance, partitioning, schemes utilization,},
number = 1,
timestamp = {2014-02-21T08:00:08.000+0100},
title = {{Analyzing the Load Balance of Term-based Partitioning}},
url = {http://ijacsa.thesai.org/},
volume = 2,
year = 2011
}