cvcomp                  package:gcl                  R Documentation

_C_o_m_p_a_r_e _t_w_o _m_o_d_e_l_s _u_s_i_n_g _c_r_o_s_s_v_a_l_i_d_a_t_i_o_n

_D_e_s_c_r_i_p_t_i_o_n:

     unction to perform crossvalidation comparison of two predictive
     models on the same data.

_U_s_a_g_e:

     cvcomp(df, mb1, mb2, eval, folds = 5, seed = NULL, cv.verbose = F, ...)

_A_r_g_u_m_e_n_t_s:

      df: The data frame, last column is outcome

     mb1: Model builder 1, must return a function that takes 'df' as
          input and returns a matrix where entry (i,j) is the
          classifiers belief of case i's memebership in class j

     mb2: Model builder 2, must return a function that takes 'df' as
          input and returns a matrix where entry (i,j) is the
          classifiers belief of case i's memebership in class j

    eval: Evaluation function, takes as input classifier generated by
          mb[12] above and data frame 'df'

   folds: Number of folds.

    seed: Random seed.

cv.verbose: If TRUE, spew info.

     ...: Passed on.

_V_a_l_u_e:

     Returns a list. 

      tt: T-test of cv differences

    tcis: cv results from mb1

    lcis: cv results from mb2

_A_u_t_h_o_r(_s):

     Staal A. Vinterbo staal@dsg.harvard.edu

_S_e_e _A_l_s_o:

     'cv','cv52', 'acc.eval','ci.eval'

_E_x_a_m_p_l_e_s:

     ## Not run: 
     cvcomp(df, gcl, tcl, acc.eval)
     ## End(Not run)

