Terrier Core

Allow fields to contain count information

Details

  • Type: Improvement Improvement
  • Status: Resolved Resolved
  • Priority: Major Major
  • Resolution: Duplicate
  • Affects Version/s: None
  • Fix Version/s: 3.0
  • Description:
    Hide
    The fields support introduced for Terrier 1.0 centre around the concept of 'does the term occur in field f in this document?'

    However, these fields pre-date the use of field-based weighting models, as proposed by Zaragoza et al. [TREC 2004]. For such field-based weighting models, the 'number of times that the term occurs in field f in this document' is the important, not just the presence.

    Terrier should support such counting fields, in terms of indexing support and Matching/weighting model support.
    Show
    The fields support introduced for Terrier 1.0 centre around the concept of 'does the term occur in field f in this document?' However, these fields pre-date the use of field-based weighting models, as proposed by Zaragoza et al. [TREC 2004]. For such field-based weighting models, the 'number of times that the term occurs in field f in this document' is the important, not just the presence. Terrier should support such counting fields, in terms of indexing support and Matching/weighting model support.
  1. TR-13.v0.patch
    (53 kB)
    Craig Macdonald
    08/May/09 10:10 AM

Issue Links

Activity

Hide
Craig Macdonald added a comment - 12/Feb/09 6:38 PM

Lexicons will have to contain field information. It is important that the Lexicon rewrite facilitate this.

Show
Craig Macdonald added a comment - 12/Feb/09 6:38 PM Lexicons will have to contain field information. It is important that the Lexicon rewrite facilitate this.
Hide
Craig Macdonald added a comment - 18/Mar/09 6:37 PM

This is also waiting for TR-20. Indeed, TR-20 contains the FieldPosting interface that this patch will implement.

Show
Craig Macdonald added a comment - 18/Mar/09 6:37 PM This is also waiting for TR-20. Indeed, TR-20 contains the FieldPosting interface that this patch will implement.
Hide
Jeffye added a comment - 14/May/09 5:28 PM

I think It's very hard to patch this. Could you write a step-by-step tutorial? Or release a new 2.x version? Thanks!

Even after I fixed some minor problems in the patch files, I still can not get through.
My patch sequence: TR-20.v1.patch , TR-14.v3.svn.patch , TR-13.v0.patch . Is there any other strict I should follow?

Show
Jeffye added a comment - 14/May/09 5:28 PM I think It's very hard to patch this. Could you write a step-by-step tutorial? Or release a new 2.x version? Thanks! Even after I fixed some minor problems in the patch files, I still can not get through. My patch sequence: TR-20.v1.patch , TR-14.v3.svn.patch , TR-13.v0.patch . Is there any other strict I should follow?
Hide
Craig Macdonald added a comment - 08/Mar/10 1:53 PM

Duplicate of TR-43, TR-48, TR-69, TR-70

Show
Craig Macdonald added a comment - 08/Mar/10 1:53 PM Duplicate of TR-43, TR-48, TR-69, TR-70

People

Dates

  • Created:
    12/Feb/09 6:32 PM
    Updated:
    08/Mar/10 1:53 PM
    Resolved:
    08/Mar/10 1:53 PM