Terrier Core

Terrier should allow us to set the runtag in our runs

Details

  • Type: New Feature New Feature
  • Status: Resolved Resolved
  • Priority: Trivial Trivial
  • Resolution: Fixed
  • Affects Version/s: 3.0
  • Fix Version/s: 3.0
  • Component/s: .applications
  • Description:
    By being able to assign a tag for our produced runs within Terrier, we can better organise experimentation with different techniques, as well as avoid having to set the tag for actual TREC submission runs manually.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Rodrygo L. T. Santos added a comment - 16/Nov/09 4:56 PM

Committed to SVN. Run tags can be set with the trec.runtag property.

Show
Rodrygo L. T. Santos added a comment - 16/Nov/09 4:56 PM Committed to SVN. Run tags can be set with the trec.runtag property.
Hide
Permalink
Iadh Ounis added a comment - 30/Nov/09 3:31 PM

Was this not an existing feature? i.e. automatically recording the configuration file used, and its associated runtag?
I guess that you still have to choose manually the runtag? How would you do it automatically?

Show
Iadh Ounis added a comment - 30/Nov/09 3:31 PM Was this not an existing feature? i.e. automatically recording the configuration file used, and its associated runtag? I guess that you still have to choose manually the runtag? How would you do it automatically?
Hide
Permalink
Rodrygo L. T. Santos added a comment - 30/Nov/09 3:47 PM

The automatic runtag assignment is still available, and is actually the default mechanism. The only new thing is the possibility to manually assign an arbitrary tag. It can be useful, for example, when summarising the results of lots of experiments directly into a latex table, in which case you could give your runs the caption that will appear in the tables, instead of having to create an additional mapping between the system generated tag and the one you want to display.

Show
Rodrygo L. T. Santos added a comment - 30/Nov/09 3:47 PM The automatic runtag assignment is still available, and is actually the default mechanism. The only new thing is the possibility to manually assign an arbitrary tag. It can be useful, for example, when summarising the results of lots of experiments directly into a latex table, in which case you could give your runs the caption that will appear in the tables, instead of having to create an additional mapping between the system generated tag and the one you want to display.
Hide
Permalink
Iadh Ounis added a comment - 30/Nov/09 4:54 PM

Ok. Good. Can someone test so as to commit to system.

Show
Iadh Ounis added a comment - 30/Nov/09 4:54 PM Ok. Good. Can someone test so as to commit to system.

People

Dates

  • Created:
    16/Nov/09 4:54 PM
    Updated:
    05/Mar/10 5:24 PM
    Resolved:
    16/Nov/09 4:54 PM
Atlassian JIRA (v4.1#519) | Report a problem | Request a feature | Contact administrators
Powered by a free Atlassian JIRA open source license for Univ of Glasgow. Try JIRA - bug tracking software for your team.