共查询到20条相似文献，搜索用时 31 毫秒
1.
Robert A. Rescorla 《Learning & behavior》1992,20(3):223-232
In three experiments with rats as subjects, instrumental training procedures were used to study the format of encoding of the reinforcing outcome (O). At issue is the relative contribution of response-outcome (R-O) associations between responses and their earned outcomes and of O-R associations between anticipated outcomes and responses reiaforced in their presence. In Experiments 1 and 2, R earned one O during a stimulus that controlled the anticipation of another O. Devaluation and transfer tests suggested that the earned O was more critical than the anticipated O in controlling behavior. In Experiment 3, a differential-outcomes procedure was used, with consistent R-0 relations arranged in groups that differed in the consistency of O-R relations. Subsequent devaluation of O produced similar selective depression of R, regardless of the O-R relations. These results suggest that an R-O association can contribute to instrumental performance more than does an O-R association. 相似文献
2.
In three experiments using rats, we examined the role of a discriminative stimulus (S) in governing the relation between a response (R) and an outcome (O) in an appetitive instrumental learning paradigm. In each experiment, we attempted to distinguish between a simple S-O association and a hierarchical relation in which S is associated with the R-O association. We used three variations on discriminative training procedures and three different assessment techniques-for revealing the hierarchical structure. In Experiment 1, we employed a training procedure in which S signaled a change in the R-O relation but no change in the likelihood of O. Although such an arrangement should not produce an excitatory S-O association, it nevertheless generated an S that controlled responding and transferred that control to other responses. In Experiment 2, we used a discrimination procedure in which two Ss each had the same two Rs and Os occur in their presence but each S signaled that a different R-O combination would be in effect. This design provided the opportunity for equivalent pairwise associations among S, R, and O but unique hierarchical relations. The subjects learned the hierarchical structure, as revealed by the specific depressive effect of a subsequent lithium-chloride-induced devaluation of O on responding only in the presence of the S in which that response had led to that outcome. In Experiment 3, one S signaled two different R-O outcomes. Then, two new stimuli were presented with the original S; the R-O relations were retained in the presence of one of the added stimuli but were rearranged in the presence of the other. The added S came to control less responding when it was redundant with respect to the R-O relations than when it was informative. Although all of the results were of modest size and each has an alternative interpretation, together they provide converging evidence for the hierarchical role of S in controlling an R-O association. 相似文献
3.
In three experiments the sensitivity of instrumental responding to revaluation of the instrumental outcome in the absence of experience with the revalued outcome was examined. Hungry rats were trained to make one response for food pellets and a different response for sucrose liquid. In Experiment 1, these responses were tested in extinction when the animals were either thirsty or hungry. A significant preference for the sucrose-trained response was observed in the test conducted under thirst but not in that conducted under hunger. In Experiments 2 and 3, the effect of experience with sucrose under thirst on the magnitude of this preference was explored. Following training of the instrumental responses in Experiment 2, half of the animals received presentations of sucrose while they were thirsty; the other half received sucrose while they were hungry. In Experiment 3, the same design was used but these sucrose presentations were made contingent on an instrumental response. Also in Experiment 3, the specificity of the sucrose-response preference to a shift to thirst was examined by testing under increased and decreased levels of hunger. The results of those experiments indicated that the sucrose-response preference is exhibited only under thirst and that exposure to the sucrose under thirst only marginally enhanced that preference. These findings suggest that instrumental responding may be modified by changes in the value of its outcome in the absence of experience with the revalued outcome. 相似文献
4.
We conducted three experiments to investigate the associative structure underlying the reinstatement of instrumental performance
after extinction. In each experiment, rats were initially rewarded on two responses with different outcomes. At test, both
responses were extinguished in order to assess the impact of a single noncontingent outcome delivery on response selection.
Experiment 1 found evidence of outcome-selective reinstatement (i.e., more responses were performed on the lever that was
trained with the reinstating outcome than on the other lever). Experiment 2 demonstrated that the outcome’s capacity to reinstate
performance was not affected by a reduction in its motivational value. Experiment 3 found evidence that the reinstating outcome
selectively retrieved the response it signaled rather than the response it followed during training. Together, these findings
are consistent with the view that instrumental reinstatement depends on the discriminative stimulus properties of the reinstating
outcome. 相似文献
5.
Ruth M. Colwill 《Learning & behavior》1993,21(4):337-345
The effect of training a positive discriminative stimulus (S+ ) as a signal for the nonreinforcement of an instrumental response (S?) on the ability of that stimulus to evoke its original instrumental response was examined in three experiments using rats. In all three experiments, two different stimuli were established as S+s for different response-outcome relations. In Experiment 1, an S+ was less effective in controlling its original response after it had undergone training as an S? for a new response that earned the same outcome than it was after training as an S? for a response that earned a different outcome. Experiment 2 established that this effect was not mediated by Pavlovian inhibitory conditioning produced by the negative correlation between the S+ and the outcome during S? training. Simply arranging a negative correlation between S+ and the outcome whose occurrence it had previously signaled did not impair the ability of that S+ to elicit its original response. In Experiment 3, the response-evoking properties of an S+ were found to be undermined by using the S+ as a signal for the simple extinction of a new response trained with the same outcome, but not with a different outcome. These results suggest that positive discriminative stimuli use their associations with the outcomes earned in their presence to control the responses that earned those outcomes. 相似文献
6.
Three different techniques were employed to analyze the associative structures mediating performance on an instrumental biconditional discrimination. In all three experiments, rats were trained concurrently on two tasks in which different stimuli signaled which one of two responses would be followed by reward. In each task, one response was rewarded in one stimulus and the other response was rewarded in the other stimulus. Correct responses earned pellets in one task and sucrose in the other task. The transfer procedure was used in Experiment 1A to identify whether or not an association developed between a biconditional discriminative stimulus and its instrumental outcome. Evidence was obtained that a biconditional cue elevated preferentially a new response trained with the same outcome. Experiments 1B and 3 examined the potential contribution of this stimulus-outcome association to biconditional performance by training the biconditional cues as signals (S-s) for the nonreinforcement of a different response. There was no evidence that this operation interfered with the ability of a biconditional cue to control performance of its correct response. In Experiments 1B and 2, the value of the instrumental outcome was reduced in an attempt to assess the contribution of stimulus-response associations to performance on the biconditional discrimination. The results of Experiments 1B and 2 reveal that correct responses were depressed following devaluation of the outcome used to train them, suggesting that learning about the response-outcome relation occurs. The implications of these results for binary and hierarchical models of instrumental learning are discussed. 相似文献
7.
Robert A. Rescorla 《Learning & behavior》1993,21(4):327-336
The associative changes that occur in extinction were investigated in four instrumental learning experiments. Experiment 1 used transfer based on a shared outcome to detect the continued presence of response-outcome (R-O) and stimulus-outcome (S-O) associations after a response had been nonreinforced in the presence of its controlling stimulus. Experiments 2–4 found that extinction resulted in the learning not to make a particular response in the presence of a particular stimulus, despite those continued R-0 and S-0 associations. These results suggest that extinction may superimpose upon those original outcome associations an inhibitory S-R association. 相似文献
8.
Ruth M. Colwill 《Learning & behavior》1991,19(4):326-336
Three experiments using rats examined whether a signal for the nonreinforcement of an instrumental response (S-) provided information about the identity of the omitted outcome. In all three experiments, one stimulus was established as a signal for the nonreinforcement of a response that earned food pellets and another stimulus signaled the nonreinforcement of a response that earned liquid sucrose. Experiment 1 found that each S-suppressed another instrumental response trained with the same outcome significantly more than a response trained with a different outcome. Using a variant of this transfer design, Experiment 2 demonstrated that an S- was slower to develop discriminative control over a new response reinforced in its presence with the same outcome compared with an outcome different from the one whose omission-the S- had previously signaled. Experiment 3 examined transfer of the S- stimuli to a response trained with two outcomes, one of which had subsequently been devalued. Performance of this response significantly increased in the presence of a signal for the omission of the devalued outcome, but decreased in the presence of a signal for the omission of the valued outcome. These results suggest that S-s do provide information about the identity of omitted response-contingent outcomes. 相似文献
9.
Three experiments, using rats, demonstrated the encoding of a food unconditioned stimulus (US) in a simple Pavlovian conditioning paradigm. In all three studies, one stimulus was used to signal the delivery of pellets and a different stimulus was used to signal the delivery of sucrose. In Experiment 1, postconditioning devaluation of one of the food USs selectively reduced the frequency of conditioned magazine-directed behavior during the stimulus trained with that US. In Experiment 2, transfer of the stimuli to instrumental responses resulted in selective depression of the response trained with a different outcome. In Experiment 3, acquisition of stimulus-outcome learning was impaired by unsignaled intertrial presentations of the same outcome but not of a different outcome. These results indicate that a detailed representation of the outcome is encoded in the normal course of Pavlovian conditioning. 相似文献
10.
Robert A. Rescorla 《Learning & behavior》1992,20(2):104-111
Three experiments investigated the impact on instrumental response-outcome (R-O) associations of arranging for O to occur independently of R. In each experiment, that arrangement resulted in reduced responding. But a transfer test with a separately trained stimulus revealed the continued strength of the R-0 association. That stimulus augmented equally an R with which it shared an O, whether or not that R had been decremented by independent presentations of O. These results suggest that response-independent outcome presentation decrements responding by means other than modifying the R-0 association. 相似文献
11.
Robert A. Rescorla 《Learning & behavior》1990,18(2):206-211
In three experiments, thirsty rats were trained to make several instrumental responses whose outcomes differed in which of two relatively inconsequential flavor features they contained. In Experiment 1, one of the features was subsequently devalued by pairing it with lithium chloride; in Experiment 2, it was enhanced in value by pairing it with sucrose. In both experiments, differences in the value of the features resulted in parallel differences in the likelihood of the responses during a subsequent extinction test. In Experiment 3, the animals chose between these responses in the presence of discriminative stimuli that had signaled the occurrence of these different features following another response. The stimuli selectively augmented the likelihood of the response with which they shared training by the same-flavored consequence. These results indicate that rats can separately encode features that differ along one dimension, both in the association between an instrumental response and its outcome, and in the association between a discriminative stimulus and that outcome. 相似文献
12.
Four experiments were conducted to explore outcome-specific transfer from causal predictive judgments to instrumental responding. A video game was designed in which participants had to defend Andalusia from navy and air force attacks. First, they learned the relationship between two instrumental responses (two keys on a standard keyboard) and two different outcomes (destruction of the ships or destruction of the planes). Then they learned to predict which of two different stimuli predicted which outcome. Finally, they had the opportunity of making either of the two instrumental responses in the presence of either stimulus. Transfer was shown as a preference for the response that shared an outcome with the current stimulus. The presentation of the stimulus during the test produced a decrease in the overall rate of response. Responding to a neutral stimulus in Experiments 2 and 3 suggested that this overall decrease in responding was due to a combination of the time needed to process the meaning of the stimulus and the activation of the representation of the outcome in the presence of the stimulus during the test. Transfer between predictive judgments and instrumental responding mirrors the outcome-specific Pavlovian instrumental transfer observed in conditioning studies with rats. 相似文献
13.
Robert A. Rescorla 《Learning & behavior》1993,21(3):238-245
In four experiments, rats learned initial response-outcome (R-O) associations in an instrumental training task. They then were given training of those same responses either with another outcome (Experiments 1 and 2) or with nonreward (Experiments 3 and 4). The presence of the original R-O associations was detected by measuring the depressive effect on responding of devaluing that O by pairing with LiCl. The results indicated that the original R-O associations remained intact through both potentially interfering treatments. 相似文献
14.
A series of four experiments, employing mice, investigated the generality of the learned helplessness phenomenon. The first two experiments used preexposure to aversive stimuli (shock), while the other two used preexposure to appetitive stimuli (food). In all of the studies, subjects were preexposed to contingent, noncontingent, or no stimuli (except for Experiment 2) in a Skinner box. During the test, animals preexposed to shock were tested with food, and those preexposed to food were tested with shock. The test was conducted in a similar situation, a Skinner box (Experiments 1, 3), or a different situation—a runway (Experiments 2, 4). Performance decrements were evident when subjects that were preexposed to a noncontingent stimulus were compared with subjects preexposed to contingent stimuli. The differences between the contingent and the noncontingent groups were significant, as were the differences between the contingent and the nonpreexposed groups (except for Experiment 1). The effects cut across the different types of stimuli, situations, and response requirements of the preexposure and test phases. 相似文献
15.
Four experiments examined transfer of differential outcome performances to new choice responses in pigeons. Experiments 1A and 1B showed that new responses trained off a matching-to-sample baseline readily substituted for the choice alternatives in differential outcome matching, provided that they shared the same outcome associations as the alternatives they replaced. Experiment 2 showed that comparison responses trained on baseline, but in a task in which their different outcomes occurred equally often following each sample (viz., one-to-many matching), substituted for the choices in a standard, differential outcome task. Experiment 3 showed, somewhat surprisingly, that the choices in the latter task were likewise effective substitutes in one-to-many matching. These results pose separate challenges for standard two-process theory and for the bidirectional account of differential outcome performance, and they suggest other cues that pigeons may use to predict outcomes. 相似文献
16.
Robert A. Rescorla 《Learning & behavior》1999,27(2):140-151
In four experiments, rat subjects were used in appetitive Pavlovian magazine-approach and instrumental conditioning procedures. Experiments 1 and 2 found successful blocking of the Pavlovian conditioning of X when it was reinforced in an AX compound after prior conditioning of A. This occurred whether the outcome following AX was the same as or qualitatively different from what followed A. Experiment 3 repeated those findings but also used a transfer procedure to identify the individual associations between X and outcomes. Stimulus X developed an association with the outcome following AX when that outcome differed from that following A alone but not when it was the same as that following A alone. Experiment 4 repeated that pattern of observations for the case of an X that was an instrumental discriminative stimulus. These results suggest that different associative structures may result from a qualitatively changed and unchanged outcome in a blocking experiment. The results are related to comparable findings for the case of overexpectation. 相似文献
17.
Robert A. Rescorla 《Learning & behavior》1997,25(4):485-497
In six experiments, rats received discriminative training in which making a response (R) during a stimulus (S) produced a particular outcome (O). In Experiment 1, that outcome was replaced by a second outcome and responding was tested either immediately or after a delay. More substantial responding was observed with the delayed test. In Experiment 2, a test of transfer to new responses suggested that the growth in performance was not attributable to greater use of particular S-O associations. However, in Experiment 3, the growth in responding was found to be specific to particular S-R combinations. Experiment 4 replicated that specificity and demonstrated the importance of using two different outcomes for obtaining the growth in responding with time. Experiments 5 and 6 repeated these observations for the case of extinction, in which O was replaced by nonreinforcement. These results are interpreted as suggesting that an outcome-independent inhibitory S-R process develops, both with extinction and with the use of a second outcome, but dissipates with time. 相似文献
18.
William Timberlake 《Learning & behavior》1979,7(3):277-288
Separation of the contingent and noncontingent effects of a schedule on amount of instrumental responding is desirable but difficult in schedules that involve instrumental and contingent responses that are either highly probable or very similar. Three studies in which rats were required to lick a solution of .1% saccharin for access to a preferred solution of .4% saccharin showed that neither single nor paired operant baselines of the instrumental response allowed accurate separation of the contingent and noncontingent effects of a fixed-ratio schedule. Two within-subject yoking procedures provided the best baselines of noncontingent effects: the massed baseline measured amount of .1% licking when each subject received free access to the total amount of .4% licking it obtained at asymptote under the schedule; the matched baseline measured .1% licking when each subject received the same access to the .4% solution, but presented in the intermittent pattern obtained during the schedule. Of the three algebraic models used to predict noncontingent effects, the substitution model was most promising, but still not adequate. The procedure of a between-subjects yoked control was also not effective. 相似文献
19.
Antonio Maldonado Andrés Catena Antonio Cándido Inmaculada García 《Learning & behavior》1999,27(2):168-180
A noncontingent experience affects the subsequent detection of positive and negative contingencies between the same events. Experiments 1 and 2 showed that such preexposure can produce both an impairment in the detection of subsequent positive contingency and a facilitation of a negative one, independent of the level of contingency during the contingent phase. Experiment 3 raised difficulties for a model that assumes that associations to the context can explain this asymmetrical effect. Experiment 4 suggested that the different weights usually assigned to the different types of trials when computing the contingency between events can change as a result of a noncontingent experience with the same events. This change supports an account of the asymmetrical effect by a belief revision model based on a mechanism that updates the weights of the different trial types as a function of previous experience. More generally, the belief revision model is a statistical (i.e., nonassociative) model of learning that is capable of accounting for trial-order effects, which have long posed problems for statistical models. 相似文献
20.
Preschool children (3–4 years old) were trained to perform two actions to gain different outcomes, in the form of video clips
from different cartoons, before one of these outcomes was devalued by noncontingent exposure. The effect of outcome devaluation
was subsequently assessed in an extinction test by giving children the opportunity to perform both actions in the absence
of any outcomes. When the two actions were trained concurrently, performance during the test was modulated by outcome value
and children showed a preference for the action trained with the currently valued outcome. By contrast, when each action was
trained separately on different trials, test performance was insensitive to outcome devaluation. These effects of the training
schedules are interpreted in terms of dual-process theories of action control. 相似文献